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1.  SUMMARY  OF  WORK  TASKS,  RESULTS, 
AND  CONCLUSIONS 

1.1  SUMMARY  OF  WORK  TASKS  AND  RESULTS 


The  main  object Iv-  '•  of  this  project  were  to; 

• Simulate  ^ j operation  of  seismic  and  seismic/acoustic 
classifiers:  developed  by  Sylvania  and  Honeywell  for  the 
U.S.  Army. 

• Evaluate  the  performance  (i.e.,  overall  accuracy  and 
site  independence)  of  the  simulations  using  field 
seismic  and  acoustic  waveforms. 

• Determine  whether  an  optimal  classifier  using  a composite 
set  of  features  could  be  found  to  improve  the  six  target- 
class  discrimination  accuracies. 

• Establish  the  degree  of  separability  of  the  six  target 
classes  using  the  composite  feature  set. 

• Investigate  alternative  means  of  classification  based 
on  the  composite  feature  set. 


The  simulated  Sylvania  and  Honeywell  seismic  target  classifiers 
(STC's)  and  seismic/acoustic  target  classifiers  (SATC's)  were 
extensively  tested  to  ensure  that  the  respective  digital  simu- 
lations mimicked  the  analog  circuitry  as  closely  as  possible. 

All  classifier  accuracy  comparisons  in  this  report  are  based 
on  a 10-second  epoch.  That  is,  a classification  is  made  for 
each  10-second  signature  and  it  is  compared  to  the  correct 
target  class.  The  overall  accuracy  for  one  vehicle  run , there- 
fore, would  be  equal  to  the  number  of  correctly  classified  10- 
second  epochs  divided  by  the  total  number  of  epochs  for  that 
run . 


1 


The  six  target  class  (tracked  vehicle,  wheeled  vehicle,  fixed- 
wing  aircraft,  rotary-wing  aircraft,  personnel,  nuisance) 
accuracies  that  resulted  when  the  671-record  digitized  field 
data  were  classified  by  the  Sylvania  and  Honeywell  STC's  and  SATC's 
are  given  in  Table  1.1.  It  can  be  seen  that  low  accuracies, 
severe  biases,  and  considerable  site  dependencies  resulted 
with  all  four  classifiers.  None  of  the  four  can  be  considered 
to  be  an  acceptable  design. 

The  inherent  separability  of  each  of  the  four  feature  sets, 
independent  of  the  classifier  weights,  was  established  via  a 
clustering  analysis,  which  is  a way  to  determine  regions  in 
the  feature  space  in  which  the  10-second  records  from  each  target 
class  are  located  when  all  N features  are  considered  simultaneously. 


j 
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CONFUSION  MATRICES  FOR  FOUR  CURRENT  CLASSIFIERS 

(XiNKISION  MAI’UICKS  l-OH  rHK  SYI.VAMA  .ST<‘  X IVI  I.AT  ION 


True 

Ik-I 

•i.sloti 

(las 

;s 

Cl  a .s 

Cla.ss 

Local  ion 

Class 

f 

'7  ~ 

_IL 

_L 

fi 

J-L 

TiijLal 

Accuracy 

Ft  UraBR 

1 

21 

it 

8 

2 

0 

0 

40 

..53 

2 

21 

17 

0 

T 

0 

0 

39 

.44 

3 

6 

47 

0 

0 

1 

0 

51 

.00 

4 

0 

34 

0 

0 

2 

0 

36 

.00 

5 

0 

0 

0 

0 

0 

n 

0 

- 

6 

1 

0 

1 

0 

0 

0 

2 

.00 

Grayling 

1 

32 

15 

8 

0 

0 

0 

55 

.58 

2 

4 

66 

0 

0 

0 

0 

70 

.94 

3 

0 

0 

0 

0 

0 

0 

0 

- 

4 

0 

0 

0 

0 

0 

0 

0 

- 

5 

0 

0 

0 

0 

0 

0 

0 

- 

6 

0 

11 

0 

0 

0 

0 

11 

.00 

Yuioa 

1 

117 

35 

50 

1 

0 

40 

243 

.48 

2 

43 

38 

1 

0 

0 

0 

82 

.46 

3 

0 

0 

0 

0 

0 

0 

0 

- 

4 

0 

0 

0 

0 

0 

0 

0 

- 

5 

8 

26 

0 

0 

0 

0 

34 

.00 

6 

5 

0 

0 

0 

0 

0 

5 

.00 

Ovu  ra 1 1 Accuracy: 

291/671 

- .43 

CONFUSION  MATRICES  FOR 

THE 

SYLVAN I A 

SATC  SIMULATI0.N 

True 

IV. 

c 1 s 1 on 

Class 

Class 

Cl  ass 

Local Ion 

Class 

1 

2 

_3_ 

.i_ 

_5_ 

Total 

Accuracy 

Ft . BragR 

1 

1 

6 

0 

25 

5 

0 

40 

. 10 

2 

10 

4 

0 

8 

17. 

0 

39 

. 10 

3 

1 

8 

0 

3 

42 

0 

54 

.00 

4 

0 

21 

0 

0 

15 

0 

36 

.00 

5 

0 

0 

0 

0 

0 

0 

0 

- 

6 

0 

1 

0 

1 

0 

0 

2 

.00 

Grayling 

1 

0 

10 

0 

32 

13 

0 

55 

.00 

bit 

2 

0 

18 

0 

18 

34 

0 

70 

3 

0 

0 

0 

0 

0 

0 

0 

~ 

4 

0 

0 

0 

0 

0 

0 

0 

- 

5 

0 

0 

0 

0 

0 

0 

0 

- 

6 

0 

0 

0 

0 

11 

0 

11 

.00 

Yuma 

1 

7 

26 

0 

202 

6 

2 

243 

.03 

2 

IS 

X 

0 

5 

47 

14 

82 

.01 

3 

0 

0 

0 

0 

0 

0 

0 

- 

4 

0 

0 

0 

0 

0 

0 

0 

- 

5 

0 

4 

0 

3 

27 

0 

34 

.79 

6 

0 

0 

0 

0 

0 

5 

5 

1.00 

38/171  - .22 


98/136  • .72 


155/364  " .4;> 


SltR 

Accoirncy 


8/171  - .05 


18/136  - .13 


40/364 


. 11 


Overall  Accuracy:  66/671  • .10 


Number 

1 

2 

3 

4 

5 

6 


Nomenclature 

Tracked  Vetucle 
Wheeled  Vehicle 
Fiaed-Wlnp  Aircraft 
Rotary-Wlntt  Aircraft 
Personnel 
Nuisance  3 


Acronym 

T\' 

WV 

FWA 

RWA 

PER 

NUS 


TABLE  1.1 
(Continued) 


CO.SKOS  ION 

«ATnu'i;.s  you 

Till. 

iioNi.ywii.1,1. 

Sir  SI.ML'I,ATION 

Locilt  ion 

True 

1 

Ji.V£.l-'*,l<in_ 



Class 

Cl  us: 

Clas.>-- 

2 

JL 

4 

f> 

Total 

Accurai 

■ “ • 

'■  ■ ■ ' 

Ft . BruKg 

1 

2 

0 

22 

8 

4 

4 

40 

.05 

2 

0 

0 

21 

10 

1 

7 

39 

.00 

3 

0 

1 

41 

1 

10 

1 

.'54 

.76 

4 

3 

0 

0 

2K 

s 

0 

36 

.78 

5 

0 

0 

0 

0 

0 

0 

0 

- 

6 

0 

0 

2 

0 

0 

0 

2 

.00 

Cray  1 lag 

1 

0 

0 

22 

3 

28 

2 

55 

.00 

2 

0 

19 

7 

1 

32 

11 

70 

.27 

2 

0 

0 

0 

0 

0 

0 

0 

- 

4 

0 

0 

0 

0 

0 

0 

0 

- 

5 

0 

0 

0 

0 

0 

0 

0 

- 

6 

0 

3 

0 

0 

7 

1 

11 

.09 

Yuma 

1 

0 

2 

89 

28 

90 

34 

243 

.00 

2 

4 

7 

30 

IS 

3 

23 

•3 

.09 

3 

0 

0 

0 

0 

0 

0 

0 

_ 

4 

0 

0 

0 

0 

0 

0 

0 

- 

5 

0 

14 

0 

10 

8 

2 

34 

.24 

6 

0 

0 

0 

4 

0 

1 

5 

.20 

Slto 

Ac<:iir.-u:y 


71/171  - .42 


20/136  - .15 


16/364  • .04 


Overall  Accuracy:  107/671  • .16 


Loca*.  lc»n 
Ft . Brasfc 


Grayling 


CONH.SKJN  MATUICK.S 

KOH 

Till: 

HOSKYWKU. 

SATC  SI  m i.  ’ 

.TIOS 

True 

Decision 

Cla.ss 

Cla.ss 

Cl  ass 

1 

2 

3 

4 

Total 

Accurac 

1 

2 

2 

0 

0 

16 

0 

40 

.05 

2 

I 

0 

0 

0 

:i.H 

0 

. 00 

3 

0 

0 

0 

0 

54 

0 

5 1 

.00 

4 

1 

0 

0 

8 

27 

0 

*’.<» 

. 22 

5 

0 

0 

0 

0 

0 

() 

0 

- 

6 

0 

0 

0 

0 

2 

0 

2 

.00 

1 

0 

5 

0 

0 

50 

0 

55 

.00 

3 

4 

23 

0 

4 

34 

0 

70 

.40 

3 

0 

0 

n 

0 

0 

0 

0 

- 

4 

0 

0 

0 

0 

0 

0 

0 

- 

5 

0 

0 

0 

0 

0 

0 

0 

- 

6 

1 

0 

0 

0 

0 

11 

.00 

J 

3 

5 

0 

0 

235 

0 

243 

.01 

3 

1 

12 

0 

1 

68 

0 

82 

.15 

3 

0 

0 

0 

0 

0 

0 

0 

- 

4 

0 

0 

0 

0 

0 

0 

0 

- 

5 

0 

28 

0 

0 

6 

0 

34 

.18 

6 

0 

0 

0 

5 

0 

5 

.00 

Slto 

Accuracy 


10/171  - .06 


28/136 


21/364 


Overall  Accuracy:  .')‘i/<>71  * .oi) 


Class 

Number 


Nomenclature 

Tracked  Vehicle 
Wheeled  Vehicle 
rixed-WlnK  Aircraft 
Kotary-Wlng  Aircraft 
Personnel 
Nuisance 

4 


After  this  is  performed  for  each  of  the  six  target  classes,  the 
degree  of  separability  (indicating  potentially  accurate  discrimi- 
nation) or  overlap  (indicating  potential  misclass if icat ions ) 
can  be  quantified. 

The  cluster  structures  of  the  feature  sets  as  developed  by  each 
of  the  four  simulations  did  not  show  promise  of  good  interclass 
separability.  The  analysis  showed  that  the  Sylvan ia  features 
(seismic  and  acoustic)  are  more  appropriate  for  the  separation  of 
tracked  vehicles  from  other  types  of  signatures,  while  the 
Honeywell  features  are  more  suited  for  the  separation  of  wheeled 
vehicles  from  signatures  of  other  classes. 

Although  none  of  the  four  feature  sets  was  capable  of  distinguish- 
ing unambiguously  among  all  six  target  classes,  the  fact  that  the 
Sylvania  features  were  good  tracked  vehicle  discriminators  and 
the  Honey  veil  features  were  good  wheeled  vehicle  discriminators 
suggested  that  a combination  of  all  four  feature  sets  could  dis- 
criminate well  among  the  six  classes. 

The  19  seismic  features  from  the  Honeywell  and  Sylvania  STC's 
were  combined  with  the  nine  acoustic  features  from  the  Honeywell 
and  Sylvania  SATC's  to  form  a composite  28  feature  set.  The 
cluster  analysis  was  repeated  using  this  combined  feature  set  and, 
indeed,  a considerable  degree  of  interclass  separability  was 
found.  In  the  design  of  new  classifiers,  the  combined  Sylvania 
and  Honeywell  feature  set  was  used,  plus  a 29th,  the  acoustic-to- 
seismic  energy  ratio.  It  was  established  that  this  feature 
was  a key  parameter  for  separating  tracked  vehicles  from  all 
other  classes. 

In  order  to  prove  the  superiority  of  the  composite,  or  "optimized" 
feature  set,  classifiers  were  designed  using  the  original  Sylvania 
and  Honeywell  features  as  well  as  a number  of  classifiers  that  used 
the  composite  features. 
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Table  1.2  lists  the  nine  classifiers,  labeled  A,  B,  I,  along 

with  their  pertinent  characteristics.  It  can  be  seen  that  the 
first  four  classifiers  are  the  Sylvania  (A  and  B)  and  Honeywell 
(C  and  D)  classifiers  with  new  weights  (based  on  this  three- 
site  data  base),  while  the  last  five  classifiers  were  newly 
designed  by  Adaptronics  during  this  project.  Classifier  E is 
identical  in  its  architecture  to  the  Sylvania  and  Honeywell 
types  except  that  29  features  are  used.  Classifiers  F and  G 
utilize  15  pairwise-voting,  1 versus  1,  discriminant  functions 
With  tie-breaking  decision  logic  to  render  one  classification. 

The  difference  between  F and  G is  that  F employs  linear  while 
G uses  nonlinear  discriminant  functions.  H and  T are  similar  to 
F and  G except  that  no  tie-breaking  logic  is  used;  instead,  any 
target  class  receiving  more  than  a threshold  number  of  votes  is 
reported. 


It  is  interesting  to  observe  that  the  linear  classifier  performed 
slightly  better  than  nonlinear  classifiers.  Although  not  tested 
specifically  in  this  program,  it  is  our  opinion  a non-linear 
classifier  would  have  outperformed  a linear  classifier  if  the 
number  of  features  were  reduced  drastically,  as  is  desired  in 
operational  systems. 


Each  of  the  nine  classifiers  was  designed  using  the  same  set 
of  signatures  — a subset  of  225  from  the  671-record  field 
data  base.  The  remaining  446  signatures  were  used  for  an  inde- 
pendent evaluation.  All  results  are  based  on  the  evaluation 
data  subset.  Each  classifier  was  designed  and  evaluated  on  data 
from  three  sites:  Ft.  Bragg,  Grayling,  and  Yuma.  Therefore, 

three  confusion  matrices  were  computed  for  each  classifier. 
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TABLE  1.2 

SIMULATED  SEISMIC  AND  SEISMIC/ACOUSTIC  TARGET  CLASSIFIERS 


An  overall  criterion  of  performance,  P,  was  established  for 
each  classifier  so  that  the  nine  (as  well  as  others  not  described 
here)  could  be  rank -ordered  on  a common  scale.  The  performance 
measure  was  a function  of  three  quantities: 

1.  A - Overall  accuracy 

2.  C - Consistency  of  overall  accuracy 

3.  S - Site  indenendence 

The  overall  accuracy,  A,  was  defined  as  the  number  of  correct 
decisions  divided  by  the  total  number  of  decisions  for  the  f.iven 
classifie".  The  value  of  A can  range  from  0,  for  total  error, 
to  1,  for  perfect  classification. 

Since  it  i.s  desirable  for  a classifier  to  perform  equally  well 
for  all  s.i.x  target  classes,  a measure  of  accuracy  consistency, 

C,  was  constructed  as  follows.  The  average  accuracy  and  its 
standard  deviation,  a,  were  computed  over  all  six  classes,  con- 
sidering all  three  sites.  If  the  average  accuracy  was  the  same 
for  all  six  classes,  a was  zero.  Conversely,  a large  value 
of  a denoted  inconsistent  classif Acation.e . Therefore,  the  con- 
sistency measure  was  computed  as:  C = 1 - u.  The  value  of  C 

can  range  from  0.45,  for  inconsistent  classifications,  to  1,  for 
perfectly  consistent  classifications. 

The  site  independence  measure,  S,  was  obtained  as  follows.  The 
six  class  accuracies  were  computed  for  each  of  the  three 
The  value  of  S was  set  equal  to  the  ratio  of  the  lowest  site 
accuracy  to  the  best  site  accuracy.  Thus,  if  a classifier  per- 
formed well  at  one  or  more  sites,  but  poorly  at  one  of  the  ocher 
sites,  S was  small.  Conversely,  S approached  1 as  a given  clas- 
sifier produced  consistent,  i.e.,  the  same,  accuracy  at  all  sites 

The  overall  performance  measure  was  computed  as  the  product  of 
the  three  criteria  of  success: 

P - A X C X S 
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Good  performance  exists  when  A,  C,  and  S each  approach  1,  as  does 
P.  Therefore,  any  group  of  classifiers  can  be  rated  on  the  above 
performance  scale,  which  ranges  from  0 for  poor  performance  to  1 
for  perfect  performance. 

Notice  that  a classifier  that  had  an  overall  accuracy  of  90 
percent  (A  = 0.9),  with  a standard  deviation  of  10  percent 
(C  = 1 - 0.1  = 0.9),  and  a worst-site-to-best-site  accuracy 
ratio  of  90/100  (S  = 0. 9/1.0  = 0.9)  — all  very  good 
values  — would  achieve  a performance  value  of 

P = 0.9  X 0.9  X 0.9  = 0.729. 

Thus,  in  practice,  a P value  greater  than  about  0.7  can  be  viewed 
as  signifying  excellent  performance. 

The  rank-ordered  performance  of  the  nine  classifiers  is  given 
in  Table  1.3.  It  can  be  seen  that  the  lowest  performers  were 
the  two  STC's  (P  = 0.155  and  0.169)  followed  by  the  two  SATC's 
(P  = 0.303  and  0.428).  Classifier  E,  the  redesigned  version 
of  Classifiers  A to  D using  the  optimized  29  features,  ranked 
fifti.  with  P = 0.639.  This  verifies  the  above  cluster  analysis 
result  that  the  combined  feature  set  is  indeed  superior  to  any 
of  the  four  feature  sets  if  one  uses  the  same  classifier 
structure . 

The  best  performers  were  the  redesigned  classifiers  that  used 
the  29th  feature  and  a more  sophisticated  decision  logic  for 
classification;  i.e.,  deciding  among  pairs  of  targets  rather 
than  one  target  from  all  others.  The  performances  of  these 
four  clas‘=ifiers  ranged  from  0.661  to  0.784. 
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TABLE  1.3 

PERFORMANCE  RANK-ORDERING  OF  NINE  CLASSIFIERS 


1.2  SUMMARY  OF  CONCLUSIONS 


This  study  hus  dsmonstratsd  that  a seismic/acoustic  six— way  target 
classifier  can  be  realized  that  has  the  following  principal 
attributes : 

9 High  single  epoch  classification  accuracy  of  approximatelv 
85  percent. 

• Consistent  accuracy  for  different  sites,  different  classes, 
and  different  ranges,  altitudes,  speeds  and  headings 

of  targets. 

• Signal  features  taken  from  prior  designs  by  Sylvania  and 
Honeywell . 

• Ability  to  discriminate  tracked  vehicles  appears  to  be 
practical  at  ranges  from  up  to  900  meters  from  the  sensor, 

• Excellent  growth  potential  based  on  reporting  of  tied 
voting  classes  appears  indicated  for  future  multitarget 
discrimination  requirements. 


More  detailed  conclusions  and  a number  of  technical  recommendations 
are  presented  in  Section  8. 


1.3  REPORT  ORGANIZATION 


The  remainder  of  this  report  is  divided  into  the  following 
sections : 

Section  2 - Describes  the  six-class  seismic/acoustic  data 
base  and  its  distribution  according  to  site, 
target  type,  target  speed,  and  range  from 
sensor. 

Section  3 - Presents  the  details  of  the  simulations  of 
the  Sylvania  and  Honeywell  classifiers. 
Results  are  shown  in  confusion  matrices 
listed  by  location. 

Sections 

4 and  5 - Give  the  results  of  the  cluster  analysis  of 

the  five  feature  sets  and  show  intra-  and 
inter-class  separability.  Also,  reduced 
dimensionality  plots  are  presented 
for  visualization  purposes. 
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Section  6 

Section  7 
Section  8 


- Presents  results  obtained  with  the  four 
Sylvania  and  Honeywell  classifier,^  after 
regeneration  of  weights  in  these  classifiers. 
The  architecture  of  five  new  seisinic/acoustic 
classifiers  using  a composite  feature  set 

is  described  and  comparative  results  are 
presented. 

- Presents  a comparison  of  the  cluster  analyses 
of  the  various  features. 

- States  the  major  recommendations  of  this  study. 


2.  SEISMIC/ ACOUSTIC  FIELD-RECORD  DATA  BASE 


2.1  INTRODUCTION 

The  data  base  used  An  this  study  consisted  of  a total  of  671 
seismic  and  acoustic  signatures  representing  six  major  target 
categories.  Each  signature  consisted  of  a data  epoch  of  10 
seconds  duration  (that  is,  10  simultaneous  seconds  for  the 
seismic  ard  acoustic  waveform:’-).-'^  The  sampling  rate  was  2,000 
Hz  for  both  waveforms.  These  data  were  provided  by  MERDC 
as  a set  of  four  digitized  magnetic  tape  reels  compatible  with 
CDC  6000  series  computers. 

An  identification  log  was  created  (based  on  the  information 
provided  by  MERDC  for  each  of  the  671  signatures)  so  that  each 
waveform  could  be  identified  by  target  class,  site,  speed, 
stake  number,  acoustic  and  seismic  gains,  and  direction  of 
travel  relative  to  the  sensor.  A listing  of  this  log  appears 
in  Appendix  A. 

2.2  SIX  TARGET  CLASSES 

The  classes  for  target  discrimination  are  the  six  shown  in 
Table  2.1.  The  class  number  will  be  used  as  a convention 
throughout  the  remainder  of  the  report,  i.e.,  Class  1 denotes 
tracked  vehicles.  Class  2 denotes  wheeled  vehicles,  etc.  Each 
of  the  signature  identities  in  the  data  log  is  tagged  with  a 
class  nximber. 


Once  a data  log  was  created,  the  data  base  was  interrogated  to 
determine  the  number  of  target  classes  that  were  represented  at 
each  site  in  order  to  determine  the  class  composition  by  target 
type.  Table  2,2  provides  this  information. 

The  exact  signature  duration  was  10,08  seconds;  however  the 
epoch  length  will  be  referred  to  as  10-seconds  for  reading 
ease  throughout  this  report. 
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1 

Tracked  Vehicle 

TV 

2 

Wheeled  Vehicle 

WV 

3 

Fixed  Wing  Aircraft 

FWA 

4 

Rotary  Wing  Aircraft 

RWA 

5 

Personnel 

PER 

6 

Nuisance 

NUS 

The  composition  of  the  data  base  is  shown  in  Table  2.2. 

Data  were  recorded  at  three  sites:  Yuma,  Grayling,  and  Ft. 
Bragg;  and  signatures  from  Classes  1,  2,  and  6 were  available 
at  all  three  locations.  Aircraft  data.  Classes  3 and  4,  were 
available  only  at  Ft.  Bragg,  and  Class  5 data  was  available 
only  at  Yuma.  Historically,  the  most  difficult  classes  to 
discriminate  have  been  Classes  1 and  2;  the  majority  of  records 
in  the  data  base  were  from  these  two  classes;  338  of  the  671 
signatures  (about  50  percent)  were  Class  1,  28  percent  were 
Class  2 and  the  remainder  of  the  data  were  spread  among  the 
other  four  classes.  (Seventy-two  percent  of  the  Class  1 data 
were  recorded  at  Yuma) . 

Class  1 was  composed  of  heavy  and  light  tracked  vehicles,  i.e., 
type  M48,  M60,  M107,  and  M113,  in  which  M48  and  M113  signatures 
were  available  fx'om  all  sites.  A variety  of  heavy  and  light 
wheeled  vehicles  were  recorded  for  Class  2,  i.e.,  type  M151 , 
M715,  M792,  T2.5,  and  T5.0,  in  which  M151  and  2.5-ton  truck 
signatures  were  available  from  all  sites.  The  aircraft  data 
were  quite  limited  with  respect  to  type;  Class  3 was  composed 
of  types  OV-10  and  TA-4 ; Class  4 was  composed  of  type  UH-1. 
Three  types  were  observed  in  Class  5;  cue  man  walking  (HI), 
three  men  walking  (H3),  and  five  men  walking  (H5).  Class  6 
data  were  composed  of  only  18  signatures. 


The  signatures  generated  by  different  targets  are  a function  I 

of  many  variables.  Of  primary  importance  are  target  speed  and  | 

distance  from  sensor  (i.e.,  range).  Many  combinations  of  these  | 

two  conditions  were  available  in  the  data  base.  Table  2.3  S 

'3 

shows  the  speed  versus  range  distribution  for  land  targets  | 

and  Table  2.4  shows  the  speed  versus  altitude  distribution  for  I 

air  targets.  | 

) 
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TABLE  2.2 

DATA  BASE  COMPOSITION 
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2.3  FORMAT  OF  SEISMIC/ ACOUSTIC  SIGNATURES 


2.3.1  Ceophone  and  Microphone  Specifications 

O’he  geophone  used  to  record  tho  seismic  data  was  the  HS-1, 
with  a sensitivity  of  0.3  V/in/sec,  a resonant  frequency  of 
7 Hz,  and  a 70  percent  damping  ratio.  The  microphone  was  a 
B and  K Model  4133  (1/2-inch).  A B and  K Model  4135  (1/4-inch) 
microphone  was  used  for  two  of  the  runs.  Both  microphones 
have  a sensitivity  of  1.25  mv/pbar  and  a flat  response  from 
39  Hz  to  40  kHz.  The  acoust  .c  pre-amp  was  the  B and  K Model 
2619.  Rockland  filters,  used  on  the  acoustic  recordings,  had 
passbands  of  5 to  5,000  Hz  at  Grayling  and  5 to  500  Hz  at  Yuma 
and  Ft.  Bragg. 

2.3.2  Digitization  Steps 

The  signals  produced  by  the  geophone  and  microphone  were  ampli- 
fied and  recorded  on  a seven  channel  analog  recorder  at  15  inches 
per  second.  (The  amplification  factors  are  listed  in  the  data  log 
shown  in  Appendix  A.)  Most  of  the  seismic  signatures  were 
recorded  at  70  db  gain,  whereas  the  acoustic  gains  varied  from 
16  db  to  70  db.  A low  gain  seismic  channel  and  an  additional 
microphone  channel  were  also  recorded  but  not  used  in  the  present 
study . 

Both  seismic  and  acoustic  signatures  were  digitized  at  a rate 
of  2,000  Hz  by  a 16-bit  Sigma  minicomputer  and  written  in 
multiplexed  form  on  magnetic  tape.  It  was  determined  from  the 
calibration  signals  that  there  was  a -4.44  db  attenuating  factor 
to  the  seismic  channel  and  a 2.0  gain  factor  to  the  acoustic 
channel  in  the  data  acquisition  system. 
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The  magnetic  tapes  produced  by  the  Sigma  minicomputer  were  made 
compatible  with  a CDC  Cyber  70  system  having  a 60-bit  word 
length.  The  least  significant  bit  was  dropped  and  four  multi- 
plexed 15-bit  words  were  packed  into  each  60-bit  word  in  order 
to  conserve  tape  footage. 

The  digitization  and  packing  of  the  60-bit  word  tapes  were  per- 
formed by  USAMERDC.  A diagram  of  the  digital  tape  evolution  is 
shown  in  Figure  2 . 1 and  the  format  of  the  packed  word  is  shown 
in  Figure  2.2. 

2.4  TARGET  VEHICLE  SITES 

The  data  base  was  recorded  a+  the  Ft.  Bragg,  Grayling,  and 
Yuma  test  sites.  Sketches  of  the  instrumentation  configura- 
tion at  each  of  these  sites  are  shown  in  Appendix  B.  The 
acoustic  recordings  used  in  this  study  were  those  taken  from 
the  microphone  nearest  to  the  road.  The  distance  between 
transducers  was  20  meters  at  each  site. 

Range  stakes  were  used  to  indicate  the  approximate  distances  of 
land  vehicles  from  the  sensors.  These  stakes  were  placed  at 
increments  of  100  meters  along  the  road,  as  indicated  on  each 
of  the  site  disr.rams  (Appendix  B).  The  stake  numbers  were 
recorded  for  each  signature  and  entered  into  the  data  log 
(Appendix  A).  These  stake  numbers  were  converted  to  approximate 
range  in  meters. 
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FIGURE  2.1;  DIGITAL  TAPE  EVOLUTION  BLOCK  DIAGRAM 


15  BITS  IS  B(T5- 

Seismic  Acoustic 


IS  BITS 


Seismic 


- IS  BITS- 

Acoustic 


60  BIT 


FIGURE  2.2:  DIGITAL  T/.PE  FORMAT  OF  THE  PACKED  60-BIT  WORD 
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3.  CLASSIFIER  SIMULATIONS 


3.1  INTRODUCTION 

Digital  simulations  were  created  for  the  prototype  hardware 
devices  listed  ir.\  Table  3.1.  The  intent  of  the  simulation  was 
to  mimic  the  analog  circuitry  as  close  as  possible  (using  the 
classifier  weights  listed  in  the  respective  manufacturer's  final 
technical  reports)  to  evaluate  the  performance  of  each  classifier 
on  an  independent  set  of  field  data. 

The  simulations  were  written  in  FORTRAN  source  coce  and  were 
performed  on  a CDC  Cyber  70  computer.  Listings  and  card  decks 
have  been  given  to  Dr.  Richard  K.  Young,  UASMERDC,  Ft.  Belvoir, 
Virginia. 

3.2  SYLVANIA  STC  AND  SATC  SIMULATIONS 

Available  information  uwed  in  performing  simulations  of  the 
Sylvania  classifiers  was  obtained  from  References  3 and  11. 
Information  was  also  gathered  via  telephone  conversations  with 
Mr.  M.  D.  Layman,  Technical  Director  of  the  Sylvania  STC  and 
SATC  projects.  Additionally,  the  schematic  diagrams  for  the 
SATC  were  provided  by  Dr.  Richard  K.  Young  of  MERDC. 


TABLE  3.1 

SIMULATED  TARGET  CLASSIFIERS 


.-Contractor 

Sylvania 

STC  -/ 

Sylvania 

SATC  -/ 

Honeywell 

STC 

Honeywell 

SATC 

Seismic 

Features 

7 

4 

12 

12 


Acoustic 

Features 

0 

3 

0 

6 


Total 

Features 

7 

7 

12 

18 


Seismic  Target  Classifier. 

2 / 

— ' Seismic/Acoustic  Target  Classifier.  SylT ania  has  redesigned 
this  SATC  using  a feature  computed  from  the  automatic  gain 
controls  circuits.  This  AGC  feature  was  not  used  in  our  simulations. 


Preceding  page  blank 
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The  Sylvania  STC  and  SATC  both  extracted  seven  features  from  the 
input  signatures.  These  features  are  listed  in  Table  3.2. 

Fv. 

f;  It  can  be  seen  that  there  are  four  seismic  features  common  to 

I both  classifiers. 

I The  feature  extractor  block  diagrams  for  the  Sylvania  STC  and 

6;  SATC  are  shown  in  Figures  3.1  and  3.2,  respectively.  The 

! feature  extractors  are  composed  of  automatic  gain  control 

(AGC)  circuitry,  full-  and  half-wave  rectifiers  squaring 
functions,  and  high  and  low  pass  filters. 

Both  the  rectifier  and  squaring  functions  are  easy  to  implement 
in  a digital  computer.  The  AGC  was  simulated  by  analyzing  the 
schematic  diagram  of  the  SATC.  Its  action  is  to  maintain  the 
amplifier  output  constant  at  3 volts  peak.  The  filters  were 
simulated  by  first  writing  the  transfer  functions  for  each  and 
then  deriving  the  appropriate  difference  equations.  Appendix  C 
presents  these  difference  euqations  plus  a flow  c!  .art  for 
tlie  feature  extractor  simulation  illustrating  the  filter  transfer 
equations . 

Both  of  the  Sylvania  classifiers  use  manual  gain  settings  which 
may  be  present  at  each  target  site.  These  were  maintained 
constant  while  processing  the  671  signatures.  The  seismic  and 
acoustic  gain  settings  were  fixed  at  98  db  and  66  db , respectively. 
Each  signature  tape  was  "de-gained"  so  that  the  seismic  and 
acoustic  signal  voltages  would  match  those  produced  by  the 
field  transducers.  Extensive  testing  was  performed  to  ensure 
that  the  digital  programs  properly  mimicked  the  operation  of 
the  analog  feature  extractors.  An  eight-channel  Brush  chart 
recorder  was  used  to  monitor  the  response  of  different  test 
signals  at  various  probe  points  in  the  simulated  network. 
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TABLE  3.2 

SYLVAN I A STC  AND  SATC  FEATURES 


Rango 

Classifier  Feature  Definition (Volts) 


STC  1 . Low  Band  Envelope  0-6 

2.  Low  Band  Envelope  Variance  0-6 

3.  Wide  Band  Envelope  0-6 

4.  Wide  Band  Envelope  Variance  0-6 

5.  Frequency  0-6 

6.  Frequency  Variance  0-6 

7.  Variance  of  Frequency  Variance  0-6 

SATC  1.  Seismic  Low  Band  Envelope  0-6 

2.  Seismic  Low  Band  Envelope  Variance  0-6 

3.  Acoustic  High  Band  Envelope  0-6 

4.  Acoustic  Wide  Band  Envelope  0-6 

5.  Seismic  Frequency  0-6 

6.  Seismic  Frequency  Variance  0-6 

7.  Acoustic  Low  Band  Envelope  0-6 


0.1  H& 


ted  from  Sylvania  STC  Final  Technical  Report  - Ref.  H. 


Some  examples  are  shown  in  Appendix  C.  Also,  each  filter  was 
tested  at  its  cutoff  frequency  with  a sine  wave  input  for  the 
-3  db  point.  The  higher  frequency  filters  tended  to  give 
a slightly  attenuated  response  because  the  shape  of  the  sine 
wave  became  slightly  distorted  as  the  test  signal  frequency 
approached  the  sampling  rate.  However,  this  result  is  to  be 
expected  in  a digital  simulation  and  is  not  considered  to  be 
a serious  deficiency. 

The  AGC  was  tested  by  observing  the  response  of  the  low  and 
wide  band  outputs  to  different  amplitude  sine  waves  at  various 
frequencies.  It  was  found  that  the  AGC  response  was  acceptable 
in  the  frequency  range  of  interest. 

The  final  tests  were  made  by  checking  the  response  of  each 
feature  to  a sinusoid,  after  amplification,  and  comparing  the 
results  with  those  specified  in  the  manufacturer's  report. 

Close  agreement  was  found. 


At  the  beginning  of  each  10-second  target  observation,  all 
filters  in  the  simulation  were  initialized  to  zero.  During  each 
10-second  epoch,  each  feature  value  was  continually  developed 
and  these  values  were  tabulated  every  0.72  second.  Three  sets 
of  features  were  computed  for  each  signature  for  two  cases: 
each  feature  was  weighted  and  summed  over  the  14  0.72-second 
time  increments,  then  normalized  by  the  sum  of  the  weights. 

The  jth  feature  is  thus  given  by: 


w. f . . 
i = 1 ^ 


f . = 

J 14 


i = 1 


ggH^npifilU;  Jiiun,wwpiyiu^ 


-»u»« m .1  lUMipiiijpw , 


In  one  case  the  weighting  vector  (w)  was  equal  to  time,  t,  in 
seconds,  over  the  IG-second  epoch.  In  the  other  case,  w was 
equal  to  the  value  of  the  v/ide  band  envelope.  The  third  set 
of  features  was  equal  to  the  feature  values  that  were  fully  developed 
at  the  end  of  the  10-second  epoch.  All  three  sets  were  tested  with 
the  classifier  weights.  It  v/as  found  that  the  third  set  yielded  the  best 
results  in  the  Sylvania  simulation,  so  it  was  used  for  the 
remainder  of  the  study. 


The  sampling  rates  for  the  acoustic  and  seismic  channels  were 
2,000  Hz  and  500  Hz,  respectively,  for  the  simulated  Sylvania 
feature  extractor.  Therefore,  every  acoustic  and  every  fourth  seismic 
data  Points  were  chosen  from  the  input  tapes. 

After  the  simulations  were  performed,  it  was  noted  that  some 
feature  values  (mostly  low  band  envelope  and  variance)  asso- 
ciated with  the  heavy  tracked-  and  wheeled-vehicle  targets 
assumed  values  larger  than  the  6-volt  capacity  for  their 
envelope  and  variance  features.  This  happened  when  the  AGC 
was  unable  to  attenuate  large  signal  amplitude  bursts  within 
the  epoch  at  a sufficiently  rapid  rate.  These  features  were 
clipped  at  the  6-volt  level.  This  occurred  for  a number  of 
Class  4 data  at  Ft.  Bragg  and  for  5-ton  trucks  and  M48's  at 
Grayling. 

The  overall  effect  of  this  clipping  is  not  known;  however, 
it  is  possible  that  it  might  have  resulted  in  a change  in  the 
feature  space.  This  should  be  investigated  in  future  analyses. 


3.2.2  Sylvania  STC  and  SATC  Classifier  Logic 

As  described,  the  feature  values  at  the  end  of  the  10-second 
epoch  were  used  in  conjunction  with  the  classifier  weights 
supplied  in  Sylvania' s Final  Technical  Reports,  to  implement 
the  linear  equations 
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where  d^  is  the  decision  logic  for  Class  i(i=l,  ...,6); 
a^Q,  ...,  a^^  are  the  classifier  weights;  and  ...,  are 

the  computed  feature  values. 

The  STC  and  SATC  weights  are  given  in  Table  3.3.  The  constants 
for  the  SATC  were  not  given  in  Ref,  3.  These  were  obtained 
from  Mr.  Marv  Layman  of  Sylvania  via  telephone  conversation. 

The  Sylvania  and  Honeywell  classifiers  each  use  a two-stage  classi- 
fication procedure.  A "target/no  target”  decision  is  made  in 
the  first  stage  — the  "no  target”  decision  signifying  Class  6 
(NUS).  A five-way  discrimination  is  then  made  in  the  second 
stage  if  a "target  present”  decision  is  reached  in  the  first 
stage.  The  first-stage  decision  is  ’target”  if  the  output 
of  the  first-stage  classifier  is  positive  and  "no  target”  if 
this  output  is  negative.  In  the  second  stage,  the  maximum 
of  five  individual  subclassifier  outputs  is  selected  as  being 
the  best  indicator  of  the  target  class. 

3.3  HONEYWELL  STC  AND  SATC  SIMULATIONS 

The  material  available  to  Adaptronics,  Inc.  for  simulation  of 
the  Honeywell  STC  and  SATC  was  contained  in  Refs.  9 andli.  In 
addition  to  these  publications,  the  Honeywell  seismic  and  seismic/ 
acoustic  feature  extractor  and  classification  programs  were 
supplied  by  USAMERDC.  The  feature  extractor  programs  and  the 
classification  programs  were  written  in  SDS  9300  FORTRAN. 

Telephone  conversations  were  held  with  Mr.  R.  R.  Roth  of 
Honeywe]!  concerning:  (1)  data  preprocessing  procedures  needed 
for  the  simulation,  (2)  the  weights  to  be  used  in  the  classifiers, 
and  (3)  certain  aspects  of  the  simulation  programs  written  by 
Honeywell . 
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The  Honeywell  simulation  wa_s  made  compatible  with  the 
CDC  6000  series  compute rs.  The  primary  ta  <k  was  the  conversion 
of  the  seismic/acoustic  fea-ture  extraction  program  to  CDC 
FORTRAN.  The  contents  of  t he  Honeywell  reports  indicated  that 
their  SATC  design  resulted  from  the  addit ion  of  six  acoustic 
features  to  the  12  STC  fea-tures.  Table  3.4  shows  the  features 
employed  by  the  Honeywell  STC  and  SATC,  and  the  weights  employed 
in  the  classifiers  are  shovr  in  Table  3.5. 

Next,  computation  steps  for  obtaining  the  feature  values  were 
compared  with  the  hardware  block  diagrams,  as  well  as  the  feature 
extractor  simulation  progra_m,  to  verify  that  the  sequences  of 
filtering,  rectification,  £tnd  amplification  of  the  signals  were 
properly  cascaded.  The  forms  of  the  difference  equations  used 
in  the  feature  extractor  program  were  re-derived  and  compared 
with  the  program  listings  t o ensure  correct  coding.  After 
verifying  that  the  listings  compared  well  with  the  hardware 
feature  extraction  processe-s,  conversion  of  the  Honeywell 
seismic/ acoustic  feature  extractor  program  to  CDC  FORTRAN  was 
done. 

Tests  were  made  on  the  conv-erted  program  by  using  input  signals 
of  known  form  and  by  printing  output  values  from  various  points 
in  the  simulation  program  iwhich  represented  feature  values.  The 
feature  extractor  program  i deluded  a provision  for  utilizing 
data  recorded  with  high  or  low  gains.  However,  since  the  field 
data  were  recorded  at  a single  gain,  this  portion  of  the  program 
was  not  exercised. 

The  Honeywell  classifiers  U-Sea  "on-off"  and  "adaptive  threshold" 
criteria  to  limit  the  opera^tion  of  the  feature  extractor  in 
order  to  increase  battery  I ife . The  setting  of  the  threshold 
values  depended  on  the  long"-term  average  signal  level.  Since 
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TABLE  3.4 

HONEYWELL  STC  AND  SATC  FEATURES 


m 


1 


ZZE© 

Feature  Definition 

Ran  ge 

STC 

1. 

Zero  Crossing  1 

0-1,240 

2. 

Zero  Crossing  2 

0-220 

3. 

Zero  Crossing  3 

0-49 

4. 

Zero  Crossing  4 

0-105 

5. 

Time  Between  Events  1 

0-45 

6. 

Time  Between  Events  2 

O'lO 

7. 

Time  Between  Events  3 

0-14 

8. 

Time  Between  Events  4 

0-21 

9. 

Smoothness 

0-46 

10. 

Duty  Cycle  Consistency 

0-397 

11. 

High  Frequency  Energy 

0-30 

12. 

Low  Frequency  Energy 

0-40 

SATC 

1. 

Zero  Crossing  1 

0-1,240 

2. 

Zero  Crossing  2 

0-220 

3. 

Zero  Crossing  3 

0-49 

4. 

Zero  Crossing  4 

0-105 

5. 

Time  Between  Events  1 

0-45 

6. 

Time  Between  Events  2 

0-40 

7. 

Time  Between  Events  3 

0-14 

8. 

Time  Between  Events  4 

0-21 

9. 

Smoothness 

0-46 

10. 

Duty  Cycle  Consistency 

0-397 

11. 

High  Frequency  Energy 

0-30 

12. 

Low  Frequency  Energy 

0-40 

13. 

Zero  Crossing  1 

0-2,518 

14. 

Zero  Crossing  2 

0-944 

15. 

Zero  Crossing  3 

0-516 

16. 

Zero  Crossing  4 

0-328 

17. 

Duty  Cycle  Consistency 

0-466 

18. 

Roughness  Count 

0-467 
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the  data  represented  discontinuous  10-second  epochs,  one-third 
of  the  data  was  often  required  to  establish  the  threshold  values. 

This  limited  the  actual  interval  for  feature  extraction  to 
times  of  much  less  than  10  seconds.  For  this  reason,  the  simu- 
lation of  the  on-off  criterion  was  not  performed,  thus  enabling 
full  10-secoud  feature  extraction. 

Prior  to  the  decision  to  not  model  the  "on-off  and  "adaptive 
threshold"  criteria,  tests  were  performed  using  signals  of  the 
same  frequency  but  of  different  amplitude,  to  determine  how 
feature  development  was  affected  by  -A^e  on-off  criterion.  These 
tests  showed  that  feature  development  exhibited  a nearly  linear 
relationship  to  the  length  of  time  the  features  were  extracted. 

This  indicated  that  the  Honeywell  features  were  dependent  on  the 
signal  frequency  and  independent  of  the  signal  amplitude. 

The  effect  of  sampling  frequency  on  the  feature  values  was  examined 
by  using  sampling  frequencies  of  2,000  Hz  and  1,000  Hz  for  the 
acoustic  and  seismic  channels,  respectively,  as  well  as  1,000 
Hz  and  500  Hz,  respectively.  It  was  found  that  the  feature  values, 
computed  for  a limited  number  of  test  records,  varied  by  five  percent 
or  less.  Therefore  the  simulations  were  performed  using  the  lower  fre 
quencies  of  1,000  Hz  and  500  Hz  for  the  acoustic  and  seismic  channels. 

The  Honeywell  classifier  was  designed  to  perform  successive 
classifications  on  a continuous  segment  of  data  lasting  signifi- 
cantly more  than  10  seconds,  using  certain  "game  rules"  to 
select  a class  for  transmission.  The  data  used  for  simulation 
normally  consisted  of  isolated  intervals  of  10  seconds,  making 
it  impracticable  to  employ  these  game  rules  in  the  simulations. 

Thus,  the  features  extracted  at  the  end  of  each  10-second  epoch 
formed  the  basis  for  classification  in  the  simulations. 
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3.4  SYLVANIA  AND  HONEYWELL  STC  AND  SATC  SIMULATION  RESULTS 
AND  SUMMARY 

The  complete  file  of  671  field  data  records  was  used  to  obtain 
the  classifications  made  by  the  Sylvania  and  Honeywell  STC  and 
SATC  simulation  programs.  Confusion  matrices  were  generated 
for  each  of  the  four  classifiers.  These  matrices  are  presented, 
by  site,  in  Tables  3.6  through  3.9.  The  diagonal  elements 
of  each  matrix  are  the  numbers  of  correct  decisions.  The  class 
total  is  the  row  sum  (i.e.,  the  siun  of  the  targets  in  the  true 
class).  Individual  target  class  accurac^^  represents  the  number 
of  correct  decisions  for  a given  class  divided  by  the  total  number 
of  records  for  which  a target  in  that  class  existed.  The  site 
accuracy  is  the  sum  of  the  diagonal  elements  divided  by  total 
number  of  elements  in  the  confusion  matrix  for  a given  site. 

The  overall  accuracy,  listed  at  the  bottom  of  the  page,  is  the 
ratio  of  the  total  number  of  correct  decisions  to  the  total 
number  of  decisions. 

It  can  be  seen  that  the  simulation  accuracies  are  quite  poor 
and  do  not  correspond  to  the  accuracies  giyen  in  the 
manufacturer's  technical  reports.  Each  classifier  exhibits 
considerable  site  dependency.  The  Sylyania  STC  decisions  are 
heayily  biased  toward  wheeled  yehicles,  and  the  Honeywell  SATC 
decisions  are  heayily  biased  toward  personnel.  The  Sylyania 
STC  had  the  best  oyerall  accuracy  of  the  four,  i.e.,  43  percent. 

(This  may  be  due  to  the  fact  that  this  classifier  was  synthesized 
using  data  that  was  recorded  at  23  different  locations.) 

The  results  giyen  in  Tables  3.6  through  3.9  show  that  low  accuracies, 
severe  biases,  and  considerable  site  dependencies  are  associated 
with  all  four  classifiers. 
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CONFUSION  MATRICES  FOR  THE  SYLVANIA  STC  SIMULATION 
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TABLE  3.7 

CONFUSION  MATRICES  FOR  THE  SYLVANIA  SATC  SIMULATION 


Overall  Accuracy:  Q6J611  = .10 


CONFUSION  MATRICES  FOR  THE  HONEYWELL  STC  SIMULATION 
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TABLE  3.9 

CONFUSION  MATRICES  FOR  THE  HONEYWELL  SATC  SIMULATION 
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Overall  Accuracy:  59/671  - .09 


4.  DETERMINATION  OF  DATA  BASE  STRUCTURE  VIA  CLUSTER  ANALYSIS 
4.1  INTRODUCTION 

Cluster  analysis  encompasses  many  diverse  techniques  for  discover- 
ing structure  within  complex  bodies  of  data.  In  a typical  example, 
one  has  a sample  of  data  units  (subjects,  persons,  cases)  each 
described  by  scores  ou  selected  variables  (attributes,  character- 
istics, measurements).  The  objective  is  to  group  either  the  data 
units  or  the  variables  into  clusters  such  that  the  elements  within 
a cluster  have  a high  degree  of  "natural  association"  among  them- 
selves while  the  clusters  are  "relatively  distinct"  from  one 
another.  The  approach  to  the  problem  and  the  results  achieved 
depend  principally  on  how  the  investigator  chooses  to  give 
operational  meaning  to  the  phrases  "natural  assocation"  and 
"relatively  distinct". 


In  cluster  analysis,  little  or  nothing  is  known  about  the  category 
structure  — that  is,  the  natural  groupings  or  classes  of  the  data. 
The  objective  is  to  discover  a class  structure  that  fits  the 
observations.  The  essence  of  cluster  analysis  might  be  viewed  as 
assigning  appropriate  meaning  to  the  terms  "natural  groups"  and 
"natural  association". 


A cluster  algorithm  can  assemble  observations  into  groups  which 
prior  misconception  and  lack  of  understanding  would  otherwise 
preclude.  A cluster  algorithm  can  also  apply  a principle  of 
grouping  more  consistently  in  a large  problem  than  can  a human. 

A series  of  interconnected  hypothesis  may  suggest  models  for  the 
mechanism  generating  the  observed  data.  Cluster  analysis  may, 
therefore,  be  used  to  reveal  structure  and  relationships  in  the 
data  — it  is  a tool  of  discovery. 


This  is  the  spirit  of  its  use  in  this  study.  The  objective  was 
to  determine  the  extent  of  homogeneity  within  each  of  the  six 
target  classes.  If  the  multivariate  data  for  a given  class  yield 
one  cluster  containing  most  of  the  observations,  the  hypothesis 
of  homogeneity  is  confirmed.  If  two  or  more  clusters  are  found 
that  contain  an  appreciable  fraction  of  the  data,  the  hypothesis 
is  rejected.  In  the  latter  case,  the  conclusion  that  two  or  more 
prototype  waveform  signatures  exist  within  the  given  target  class 
is  justified. 

4.2  SUMMARY  DESCRIPTION  OF  THE  CLUSTR  ALGORITHM 

The  algorithm  for  determining  the  data  clusters  can  be  summarized 
as  follows.  The  first  data  sample  is  introduced  and  the  first 
cell  is  centered  at  this  point.  The  cells  are  hyperellipsoids, 
and  their  initial  radii  (principal  axes)  are  preselected.  The 
birth  of  each  cell  defines  a new  cluster  in  the  space.  The  next 
sample  is  presented  and  it  either  falls  within  the  boundary  of 
the  existing  cell,  within  a "guard  zone"  surrounding  the  cell,  or 
outside  of  the  guard  zone  so  that  a second  cell  is  generated  and 
centered  at  this  point.  Similarly,  all  succeeding  points  either 
fall  within  one  of  the  cells  in  existence  at  that  time,  within 
their  guard  zones,  or  determine  the  generation  of  new  cells.  Whe] 
a point  falls  within  a cell,  the  cell's  location  (its  mean)  and 
radii  are  changed  to  accommodate  this  new  point.  The  cells  thus 
locate  themselves  at  the  dense  regions  (modes)  of  the  data  and 
assume  a shape  which  conforms  to  the  spread  of  data  about  these 
modes . 

The  algorithm  therefore  examines  the  geometric  interrelationships 
of  the  multivariate  data,  and  finds  clusters  of  data  which  are 
very  close  to  one  another,  and  hence  very  similar.  Five  results 
are  reported: 
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1.  The  number  of  cells 

2.  Their  (N-dimensional ) location 

3.  Their  (N-dimensional)  shape 

4.  The  identity  of  the  data  points  in  each  cell 

5.  The  amount  of  overlap  existing  (if  any)  between  cells 

These  results  yield  the  following  information  about  the  data  space: 

• The  structure  of  .he  space 

• The  presence  of  noisy  data 

It  The  number  and  type  of  operating  regions  of  the 
process  which  generated  the  data 

• The  presence  of  non-stationary  (time-varying)  conditions 

CLUSTR  is  a one-pass,  non-iterative  algorithm;  hence,  convergence 
to  the  final  result  is  rapid.  The  control  constants  which  govern 
the  birth  rate,  growth  rate,  and  shape  of  the  clusters  are  computed 
from  the  data. 

The  CI.USTR  algorithm  was  used  five  times  in  this  study  to  assess 
the  degree  of  similarity  between  classes,  using  data  bases  con- 
sisting of  features  from  each  of  the  four  prior-existing  classifiers 
and  using  the  combined  Sylvania  and  Honeywell  seisraic/acoustic 
features . 

4.3  RESULTS  OF  CLUSTER  ANALYSES 

The  cluster  algorithm  was  used  to  group  the  data  into  cells  for 
each  of  the  six  target  classes  and  to  determine  the  amount  of 
overlap  between  the  cells. 

Clustering  of  the  data  by  classes  was  accomplished  by  organizing 
the  data  according  to  classes  and  then  allowing  the  cluster 
algorithm  to  form  cells  from  one  class  data  independently  of  cells 
formed  from  other  class  data.  Thus,  the  cells  formed  never  contained 
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points  from  more  than  single  target  class.  This  approach, 
rather  than  the  approach  of  clustering  of  all  data  as  a single 
class,  was  taken  becavse  it  was  capiiole  of  providing  more  informa- 
tion on  the  similarity  or  dissimilarity  of  data  within  a single 
class.  The  overlap  analysis  portion  of  each  cluster  run 
resulted  in  a statistical  measurement  of  the  degree  of  overlap 
or  separation  between  cells  formed  in  the  particular  cluster  run.— ^ 
All  cells,  regardless  of  the  class  to  which  they  belonged  and  as 
long  as  they  met  minimum  size  criteria,  were  compared  with  other 
cells  to  determine  the  degree  of  statistical  overlap  or  separa- 
bility . 

In  the  analyses,  many  cells  were  formed  that  contained  only  a few 
points;  such  cells  were  not  taken  into  consideration  in  the  results 
to  be  described  nor  were  they  included  in  the  accompanying  figure 
or  tables.  No  attempt  was  made  to  correlate  these  points  with  any 
of  the  signal  identification  parameters. 

4.3.1  Cluster  Analysis  of  Honeywell  Seismic  Features 

The  12  Honeywell  seismic  features  (Table  3.4)  were  used  to  cluster 
the  data,  base  of  671  records.  A total  of  156  cells  was  formed 
with  72.6  percent  (487)  of  the  data  contained  in  the  25  largest 
cells  shown  in  Table  4.1.  The  other  184  points  were  distributed 
among  the  remaining  131  cells,  giving  an  average  point  density  of 
1.40.  (Point  density  is  defined  as  the  number  of  points  per  cell.) 
Table  4.1  identifies  the  number  of  cells  containing  a large  number 
of  points  in  each  class  along  with  the  number  of  points  contained 
within  each  cell. 


1/ 


A multivariate  F-test  was  used  to 
two  cells  being  dissimilar  at  the 
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assess  the  probp.bility  of 
0.05  level  of  significance. 


HONEYWELL  SEISMIC  FEATURES 
DISTRIBUTION  PER  TARGET  CLASS 


The  largest  Class  1 cells  did  not  exhibit  strong  grouping  ten- 
dencies either  by  vehicle  type  or  by  site.  However,  in  the 
large  cells  containing  the  Class  2 data,  several  cells  were 
composed  predominantly  of  either  5-ton  trucks  or  M151  vehicles 
from  the  Grayling  site.  One  cell  in  each  Class  3 and  one  in 
Class  4 contained  a large  majority  of  the  fixed-wing  and 
rotary-wing  data,  respectively.  (Recall  that  Class  3 and 
Class  4 data  have  no  site  variability  because  all  records 
for  these  classes  were  obtained  at  a single  site.)  Two  of 
the  three  major  cells  in  Class  5 (Cells  12  and  15)  were  com- 
posed solely  of  1-  and  5-human  records,  respectively.  The 
most  populated  Class  5 cell  was  composed  of  nearly  all  3-human 
records.  The  cells  in  Class  6 grouped  nuisance  records  by  site. 

The  results  of  the  overlap  analysis  portion  of  the  cluster 
algorithm  are  shown  in  Table  4.2.  Whenever  two  cells  have 
been  computed  to  be  statistically  separable  at  the  95  percent 
confidence  level  (via  a multivariate  F-test),  an  asterisk  has 
been  placed  in  the  appropriate  location  in  the  table.  Resulcs 
of  the  overlap  analysis  show  that  the  two  most  populated  Class  2 
cells  are  not  separable  from  each  other  and  that  neither  of 
these  cells  is  easily  separated  from  Class  1 cells.  However, 
both  cells  are  separable  from  the  most  populated  Class  1 cell. 
This  means  that  the  12  Honeywell  seismic  features  are  not,  in 
general,  good  tracked  versus  wheeled  vehicle  discriminators. 

Only  the  major  cell  from  Class  4 shows  good  separation  from  the 
populous  cells  of  other  classes.  This  means  that  rotary-winged 
aircraft  can  be  well  separated  using  these  features. 

These  conclusions  are  supported  by  the  confusion  matrices  in 
Table  3.8;  only  1 percent  and  14  percent  of  the  tracked  and 
wheeled  vehicles  were  correctly  classified,  respectively,  while 
the  aircraft  classifications  were  76  and  78  percent  correct, 
respectively . 
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The  671  records  containing  the  18  Honeywell  seismic/acoustic 
features  clustered  into  123  cells.  The  17  largest  cells,  included 
in  Table  4.3,  contain  73.3  percent  (492)  of  the  671  records. 

The  remaining  179  points  are  distributed  among  106  cells  for  an 
average  point  density  of  1.69. 

The  second  largest  tracked  vehicle  cluster,  Cell  69,  has  93.4 
percent  of  its  points  from  Yuma.  Eighty  percent  of  the  points 
in  this  cell  are  those  arising  from  M113  records,  and  the  records 
not  from  Yuma  were  also  M113  records.  Seventy-one  percent  of  the 
data  in  the  cell  were  M113  records  from  Yuma. 

Cell  70  has  75  percent  of  its  points  from  Yuma.  Cell  106  is 
composed  of  M48  records  from  Grayling, 

The  largest  of  the  Class  2 cells  contains  71  points,  with  20, 

32,  13,  and  6 points  representing,  respectively,  the  following 
vehicle  types:  M141,  2i-ton  truck,  M792,  and  M15.  Cluster  Cells 

63  and  64  are  composed  of  5-ton  truck  signature  features  and 
cluster  Cell  59  is  composed  of  24-ton  truck  records  from  the  Ft. 

Bragg  and  Grayling  sites. 

The  largest  cells  for  Class  3 and  Class  4 data  contain  about 
three-quarters  of  the  data  in  the  respective  classes.  The  Class  6 
data  are  grouped  into  three  distinct  cells  — one  cell  for 
nuisance  records  from  each  of  the  three  sites. 

Examination  of  Table  4.4  indicates  that  the  largest  cells  of  Class  4 
are  separable  from  most  major  cells  of  all  the  remaining  classes. 

None  of  the  remaining  major  cells  shows  such  a marked  degree  of 
separability  from  other  cells.  The  confusion  matrices  in  Table  3,9 
support  this  data  structure  analysis  — the  27  Class  4 records  are 
correctly  classified,  while  almost  all  other  targets  are  misclassif ied. 
These  features  were  the  worst  performers  (only  9 percent  overall 
accuracy ) . 
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TABLE  4.3 

HONEYWELL  SEISMIC/ACOUSTIC  FEATURES 
DISTRIBTUTION  PER  TARGET  CLASS 


PWWH|_ 


compared 
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4.3.3  Cluster  Analysis  of  Sylvanla  Seismic  Features 

Table  4.5  shows  the  18  largest  cluster  cells  formed  for  the  six 
target  classes  using  the  Sylvania  seismic  features.  These  cells 
contain  427  or  63.6  percent  of  the  entire  data  base.  The 
remaining  244  points  are  distributed  into  143  cells  for  an  average 
point  density  of  1.71. 

Fifty-two  percent  of  the  Class  1 data  are  contained  within  the 
most  populated  cell,  Cell  87.  Approximately  70  percent  of  the 
M60's  and  M113's,  and  31  percent  and  47  percent  of  the 
M48  and  M107  data,  respectively,  are  contained  in  this  cell. 
Eighty-three  percent  of  the  records  in  this  cell  were  obtained  at 
the  Yuma  site,  as  compared  to  the  72  percent  representation  of 
Yuma  data  in  the  entire  data  base.  The  second  largest  cell,  Cell  88, 
consists  primarily  of  M48  and  M113  Ft.  Bragg  records. 


In  general,  the  compositions  of  Class  2 cells  fail  to  show 
any  large  incongruities  between  the  distribution  of  the  Class  2 
data  base  and  cell  structures.  However,  76  percent  of  the  5-ton 
truck  data  from  the  Grayling  site,  the  only  site  from  which  5-ton 
data  were  available,  are  clustered  together. 

Class  3 and  Class  4 data  clustered  tightly,  with  all  the  points 
in  the  latter  clustered  into  a single  cell  . The  clustering 
of  Class  5 and  Class  6 data  did  not  show  any  strong  grouping 
tendencies . 

Table  4.6  presents  the  separability  of  the  cells  in  Table  4.5. 

It  shows  that  the  large  cell  of  Class  1,  Cell  87,  is  separable  from 
most  other  large  cells,  and  that  Class  3 and  Class  4 data  are  sep- 
arable from  each  other.  These  results  are  confirmed  by  the  confusion 
matrix  of  Table  3.6  which  shows  that  117  of  the  tracked  vehicles 
were  correctly  classified. 
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TABLE  4.6 

SYLVANIA  STC  TARGET  CLASS  SEPARABILITY  ANALYSES 


uniHi 


Indicates  cell  separability. 


f\ 


4.3.4  Cluster  Analysis  of  Sylvanla  Seismic/ Acoustic  Features 


k 

I'. 


Table  4.7  shows  the  22  largest  cluster  cells  formed  for  the  six 
classes  of  data  using  the  7 Sylvania  seismic/acoustic  features. 
These  cells  contain  432  points,  64.4  percent,  of  the  entire  data 
base.  The  remaining  239  points  are  distributed  among  134  cells, 
for  an  average  point  density  of  1.78. 

The  largest  Class  1 cell,  Cell  70,  contains  88  points  (26  percent) 
of  the  338  Class  1 points  in  the  data  base.  Approximately  91  per- 
cent of  the  points  in  the  cell  are  from  the  Yuma  site.  Cluster 
Cell  111  is  also  predominantly  composed  of  M113 

records  from  the  Yuma  site:  17  of  the  18  records  (approximately 

94  percent)  are  from  the  Yuma  site.  Cell  72  is  also  made  up 
predominantly  of  records  from  the  Yuma  site  (approximately  83  per- 
cent), or  14  of  the  17  records  in  this  cell.  The  points  in  Cell  72 
are  not  predominantly  for  one  type  of  vehicle. 


1 


The  most  populated  Class  2 cell.  Cell  21,  consists  primarily  of 
M792  records  from  the  Yuma  site  and  M151  records  from  the  Ft.  Bragg 
site.  Seventy-five  percent  of  the  M792  records,  and  77.8  percent 
of  the  M151  records  are  included  in  this  cell.  The  points  contained 
in  Cells  23,  25,  and  29  are  composed,  with  the  exception  of  a single 
record,  entirely  of  M151  and  2^-ton  truck  records.  The  proportion 
of  M151  records  to  2j-ton  truck  records  for  the  three  cells  are: 

1,20,  0.20,  and  4.0,  respectively. 

Data  for  the  5-ton  trucks  from  the  Grayling  site  form  separate  cells,  I 

but  are  not  included  in  the  table  of  major  cells  nor  in  the  separa-  I 

bility  figure.  ] 


Class  3 and  Class  4 data  form  tightly  grouped  cells;  however,  none  ^ 

of  the  cells  contains  a disproportionate  number  of  points  from  a 

■ I 

particular  type  of  aircraft,  if  more  than  a single  type  was  present  | 

in  the  class.  The  cells  of  Classes  5 and  6 show  little  grouping  ^ 1 

tendency,  except  that  some  three-personnel  points  are  separated.  | 

The  nuisance  points  from  Ft.  Bragg  also  form  a distinct  cell.  | 

> j 
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Table  4.8  shows  the  separability  of  the  large  cells-  Table 
4.8  shows  the  cells  of  Class  1 are  statistically 
separable  from  the  large  cells  of  all  other  classes,  while  the 
major  cells  of  the  remaining  classes  do  not  show  as  much  separa- 
bility among  each  other. 

4.3.5  Cluster  Analysis  of  Combined  Honeywell  and  Sylvania 
Features  (28) 

Table  4.9  shows  the  20  largest  cells  formed  for  the  six  class  cluster 
analysis  using  the  28  unique  seismic  and  acoustic  features  from 
the  Honeywell  and  Sylvania  simulations.  These  20  cells  contain 
560  (approximately  83  percent)  of  the  671  points  in  the  data  base. 

The  remaining  111  points  are  distributed  among  91  cells,  for  an 
average  point  density  of  1.22. 


The  most  populated  cell  in  Class  1,  cluster  Cell  57,  contains 
214  points  (approximately  63  percent)  of  all  Class  1 data,  with 
170  (approximately  79  percent)  of  the  214  points  from  the  Yuma 
site.  Approximately  82  percent  (103  of  126)  of  the  M113  records 
are  contained  in  this  cell.  There  is  not  a predominant  vehicle 
type  in  Cell  4;  however,  approximately  82  percent  (27  of 
33  points)  in  Cell  4 represent  data  from  the  Yuma  site. 

Cells  5 and  6 consist  entirely  of  M48  points  from  the  Grayling  site, 
while  Cell  1 is  composed  entirely  of  M107  records  from  the 
Yuma  site.  Cell  2 has  neither  a predominant  number  of  records 
from  a particular  site  nor  from  a particular  type  of  vehicle. 

Approximately  one-half  of  the  points  (31  of  63)  in  the  most  popu- 
lated cell  of  Class  2 are  from  2^-ton  truck  records.  The  31  points 
are  distributed  nearly  evenly  by  site  and  by  the  fraction  of  total 
24-ton  truck  records.  The  fifth  Class  2 cell.  Cell  44,  has 
11  of  its  12  points  representing  24-ton  trucks,  while  cells 
6 and  7 (Cluster  Cells  48  and  49)  consist  entirely  of  5-ton  truck 
records  from  the  Grayling  test  site. 
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TABLE  4.9 

COMBINED  HONEYWELL  AND  SYLVAN I A FEATURES 
DISTRIBUTION  PER  TARGET  CLASS 
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Class  3 data  are  found  in  one  cell,  as  is  all  Class  4 data. 

The  latter -osult  was  also  found  in  the  clustering  of  Sylvania 
Class  4 data.  Class  5 and  Class  6 data  do  not  show  noteworthy 
grouping  tendencies. 

Table  4.10  shows  that  the  most  populated  cells  of  Classes 
1,  2,  3,  and  4 data  are  not  statistically  separable  from  each 
other . 

4.3.6  Summary  of  Cluster  Analysis  and  Conclusions 

The  objective  of  the  cluster  analysis  was  to  determine  the  extent 
of  homogeneity/heterogeneity  of  each  of  the  five  feature  sets 
within  each  of  the  six  target  classes.  The  most  favorable  finding 
of  the  cluster  analysis  for  the  six-class  discrimination  problem 
would  be  (independently  of  site): 

• Intra-class  homogeneity  of  features 

• Inter-class  heterogeneity  of  features 

Of  course,  these  represent  idealized  situations  in  which  all  points 
within  a class  group  in  a single  cell  and  the  cell  for  each  class 
is  distinct  from  all  other  cells.  Such  situations  rarely  occur  with 
field  data. 

The  results  of  the  cluster  analysis  exhibit  some  of  the  ideal 
characteristics,  but  not  to  a sufficient  degree  to  render  the  six- 
class  discrimination  task  easily  manageable.  A method  of  evaluating 
the  above  two  characteristics  would  be  to  consider  the  size  of  the 
most  populated  cell  within  each  class  and  the  separability  of  such 
cells.  Therefore,  the  more  points  from  a given  class  contained 
in  the  most  populated  cell,  and  the  more  distinct  the  cell  is  from 
the  others,  the  more  easily  one  class  is  distinguished  from  the 
other . 


59 


TABLE  4.10 

HONEVWELL  AND  SYLVAN I A COMBINED  FEATURE  TARGET  CLASS  SEPARABILITY  ANALYSES 


Table  4.11  shows  the  population  of  the  largest  cells  for 
each  of  the  six  classes  based  on  the  five  cluster  studies.  Classes 
3 through  6 have  been  included  in  the  table  for  completeness  but 
were  not  analyzed  due  to  the  small  amount  of  data  in  both  quantity 
and  variety. 

Comparison  of  the  most  populated  cells  in  Classes  1 and  2 of  the 
two  Sylvania  feature  sets  against  the  two  Honeywell  features  sets 
shows  that  the  Sylvania  cells  for  Class  1 contain  more  points  than 
the  Honeywell  cells, while  for  Class  2 the  opposite  is  the  case. 

The  numbers  of  points  in  the  most  populated  cells  for  the  combined 
features  resemble  those  in  the  four  original  feature  sets. 

The  term  "variety  within  a class"  is  used  in  the  sense  of  different 
types  and  motions  of  signature  sources,  different  sites  and  dif- 
ferent climatic  conditions  for  targets  within  a given  class. 

Table  4.12  was  obtained  by  examining  the  most  populated  cells  in 
each  of  the  four  original  feature  sets  and  tabulating  the  numbers 
of  points  in  common  betv/een  these  cells  and  those  of  the  combined 
(28)  feature  set.  As  indicated  by  the  table,  the  cells  formed  by 
the  Sylvania  feature  sets  have  significantly  more  points  in  common 
with  the  combined  feature  cells  in  the  tracked  vehicle  classes 
than  do  the  Honeywell  cells,  while  the  converse  occurs  in  the  com- 
parison of  wheeled  cells  of  the  four  feature  sets  with  the  combined 
feature  cells. 

In  conclusion,  the  Sylvania  features  show  strong  potential  for 
separating  tracked  vehicles  (Class  1),  while  the  Honeywell  features 
show  strong  potential  for  separating  wheeled  vehicles  (Class  2). 
Furthermore,  the  cluster  analysis  shows  the  Honeywell  features  to 
be  capable  of  finer  discrimination  on  an  intra-class  basis,  as 
evidenced  by  cells  with  high  degrees  of  homogeneity  within  a class 
it  also  shows  the  Sylvania  features  to  be  capable  of  finer  dis- 
crimination on  an  inter-class  basis.  This  latter  conclusion  is 
supported  by  the  large,  but  distinguishable,  cells  found  for  the 
tracked  vehicle  class. 
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TABLE  4.11 


POPULATIONS  OF 

LARGEST 

CLUSTERS 

IN  EACH  TARGET 

CLASS 

Class 

Feature  Set 

1 

2 

3 

4 

5 

" 6 

Honeywell  STC 

70 

58 

38 

27 

14 

8 

Honeywell  SATC 

96 

71 

41 

27 

12 

11 

Sylvania  STC 

186 

23 

29 

36 

10 

7 

Sylvania  SATC 

88 

48 

26 

36 

16 

16 

Combined  Features 

214 

63 

45 

36 

10 

16 

TABLE  4.12 

INTERSECTIONS  OF  MOST  POPULATED  CELLS  IN  HONEYWELL  AND  SYLVAMIA 
FEATURE  SETS  WITH  MOST  POPULATED  CELLS  OF  COMBINED  FEATURE  SET 


Feature  Set 

Honeywell  STC 
Honeywell  SATC 
Sylvania  STC 
Sylvania  SATC 


Class  1 

65/70  = .93 
38/96  = .96 
175/186  = .94 
73/88  = .83 


Class  2 

47/71  = .66 
38/58  = .66 
None 

17/48  = .35 
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5.  TABULAR  CLUSTER  LISTINGS 
AND  REDUCED  DIMENSIONALITY  PLOTS 


5.1  MERGING  OF  STATISTICALLY  SIMILAR  CLUSTER  CELLS 

Part  of  the  cluster  analysis  was  to  determine  the  statistical 
similarity  among  the  cells  containing  the  largest  number  of 
points  (Section  4.3).  Those  cells  in  the  same  target  class  that 
are  statistically  similar  (based  on  a multivariate  F-test)  have 
been  merged  to  form  larger  cells.  New  mean  (X)  and  standard 
deviation  (Z)  vectors  were  recomputed  for  the  merged  cells. 

Table  5.1  shows,  for  the  five  feature  sets,  the  number  of  merged 
cluster  cells  per  class.  The  numbers  in  parentheses  indicate 
the  fraction  of  data  in  the  merged  cluster  cells  relative  to  the 
total  amount  of  data  in  the  class. 

5.2  TABULAR  CLUSTER  LISTINGS  FOR  THE  FIVE  FEATURE  SETS 

A tabular  listing  was  generated  for  the  five  feature  sets  to 
identify  the  content  of  the  cluster  cells  by  target  type,  site, 
speed,  range,  acoustic  and  seismic  gains,  and  target  direction 
of  motion.  In  addition,  the  X and  Z vectors  were  printed  showing 
their  positions  in  N-dimensional  space.  (Due  to  the  length  of 
these  listings,  they  do  not  appear  in  this  report.  However, 
copies  have  been  provided  to  Dr.  Richard  K.  Young,  USAMERDC, 

Ft.  Belvoir,  Virginia;  and  Dr.  Ted  Gifford,  REMBASS  PM,  Ft. 
Monmouth,  New  Jersey.)  An  example  for  a typical  cluster  cell 
is  shown  in  Table  5.2.  Definitions  for  the  various  fields  are 
given  in  Table  5.3.  (The  merged  cluster  cells  have  been  used 
for  these  listings.) 


NUMBER  OF  CLUSTER  CELLS  PER  CLASS  CONTAINING  THE  LARGEST  NUMBER  OF  POINTS 

(Fraction  of  Total  in  Class') 
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DEFINITIONS  FOR  TABULAR  CLUSTER  LISTING 


I , Identification 

I Number  Definition 



• 1 Title 

2 Cluster  Cell  Number. 

(Cells  with  less  than  5 hits  have  been 
excluded  from  this  printout.) 

3 Hits:  Number  of  Signatures  in  Cluster 

4 MERDC  ID  Number 


5 


Class  Number 


(a) 

1 

TV 

(b) 

2 

WV 

(c) 

3 

FWA 

(d) 

4 

RWA 

(e) 

5 

PER 

(f) 

6 

NUS 

(HI,  H3,  H5) 


i ^ 
! ^ 


6 Vehicle  Type 

7 Target  Site 


8 

Target  Speed.  (mph  for  land  vehicles 
and  personnel,  knots  for  aircraft.) 

! 

i i 

9 

Range  (meters)  or  Altitude  (feet). 

For  personnel,  range  is  given  as  stake 
numbers. 

! 1 

'1 

'll 

' 'ji 

10 

Acoustic  Gain  (db) 

■■  S 

11 

Seismic  Gain  (db) 

12 

Targe c Direction 

! 1 

i 

13 

File  Section.  (Files  longer  than  10  seconds 
were  divided  into  10  second  epochs. ) 

' ? 
! s 

1 i 

14 

15 


16 

17 


18 


Number  of  Signatures  From  Each  Site 

Number  of  Signatures  From  Each  Target 
Class,  (In  this  study  each  class  was 
clustered  separately.) 

Number  of  Vehicles  From  Each  Target  Type 

X Vector:  Indicates  the  mean  value  for 

each  feature,  or  center  of  mass  of  the 
cluster. 

Signature  Vector:  Standard  deviation 

associated  with  the  X vector. 


5.3  CORRELATION  AND  EIGENVECTOR  ANALYSIS 


As  explained  in  Section  4.1,  a cluster  analysis  is  a valuable 
tool  for  finding  the  structui > of  a multivariate  data  base. 
However,  it  is  difficult  to  visualize  a group  of  data  clusters 
in  N-dimensions  when  N is  larger  than  three.  Accordingly, 
the  dimensionality  of  the  cluster  space  has  been  reduced  via  an 
Eigenvector  transformation,  for  the  purposes  of  visualization. 
Such  a task  is  feasible  when  the  features  exhibit  high  mutual 
correlations,  in  which  case  the  redundancy  can  be  removed. 

A correlation  and  Eigenvector  analysis  of  the  671-record  data 

base  was  performed  and  high  correlations  between  many  of  the 

parameters  were  observed.  Table  5.4  shows  the  correlation 

matrix  of  the  unique  28  Honeywell  and  Sylvania  features  which 

are  identified  in  Table  5.5.  A separate  Eigenvalue  analysis 

was  performed  for  each  of  the  five  data  sets.  Table  5.6 

shows  the  amount  of  explained  variance  for  each  of  these  sets 

for  each  eigenvariable  ("z")  parameter).  Each  eigenvariable 

is  a linear  weighted  combination  of  the  original  28  features; 

*t  h 

the  weights  for  are  the  components  of  the  k Eigenvector. 

Over  94  percent  of  the  variance  is  represented  with  two  z 
features  for  the  Sylvania  feature  sets  (Table  5.6).  Therefore, 
the  w'' ylvania  cluster  can  be  reduced  to  two  or  three  dimensions 
with  small  distortion  of  interpoint  distances.  The  Honeywell 
features  were  less  mutually  correlated,  so  that  z^  and  do 
not  account  for  as  much  variance  as  is  the  case  for  the  Sylvania 
features.  However,  over  70  percent  of  the  variance  is  accounted 
for  by  z^  and  for  the  Honeywell  features. 
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TABLE  5. 5 


TWENTY-EIGHT  HONEYWELL  AND  SYLVAN I A COMBINED  FEATURES 


Feature 

Feature  Definition 

Counts/ 

Epoch 

Honeywell  Seismic 

1. 

Zero  Crossing  1 

0-1,240 

2. 

Zero  Crossing  2 

0-220 

3. 

Zero  Crossing  3 

0-49 

4. 

Zero  Crossing  4 

0-105 

5. 

Time  Between  Events  1 

0-45 

6. 

Time  Between  Events  2 

0-40 

7. 

Time  Between  Events  3 

0-14 

8. 

Time  Between  Events  4 

0-21 

9. 

Smoothness 

0-46 

10. 

Duty  Cycle  Consistency 

0-397 

11. 

High  Frequency  Energy 

0-30 

12. 

Low  Frequency  Energy 

0-40 

Honeywell  Acoustic 

13. 

Zero  Crossing  1 

0-2,518 

14. 

Zero  Crossing  2 

0-944 

15. 

Zero  Crossing  3 

0-516 

16. 

Zero  Crossing  4 

0-328 

17. 

Duty  Cycle  Consistency 

0-466 

18. 

Roughness  Count 

0-467 

Volts 

Sylvania  Seismic 

19. 

Low  Frequency  Energy 

0-6 

20. 

Low  Band  Envelope  Variance 

0-6 

21. 

Wide  Band  Envelope 

0-6 

22. 

Wide  Band  Envelope  Variance 

0-6 

23. 

Frequency 

0-6 

24. 

Frequency  Variance 

0-6 

25. 

Variance  of  Frequency 

Variance 

0-6 

Sylvania  Acoustic 

26. 

High  Frequency  Energy 

0-6 

27. 

Wide  Band  Envelope 

0-6 

28. 

Low  Band  Envelope 

0-6 

— ^Note  that  certain  fcjatures  identified  by  separate  contractors 
are  conceptually  the  same;  however,  their  methods  of  extraction 
were  different  and  therefore  all  the  features  were  included  for 
completeness.  The  similar  features  are: 


Honeywell  Seismic  Zero  Crossings 
Honeywell  Seismic  Smoothness 

Honeywell  Seismic  Duty  Cycle 
Consistency 

Honeywell  Seismic  High  and  Low 
Frequency  Energy 


Sylvania  Seismic 
Sylvania  Seismic 
Band  Frequency 
Sylvania  Seismic 
Variance 

Sylvania  Seismic- 
Envelope 


Frequency 

Wide 

Frequency 
Wide  Band 
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TABLE  5.6 

EXPLAINED  VARIANCE  OF  THE  Z-PARAMETERS 
FOR  THE  FIVE  FEATURE  SETS 

z 

Feature  Set  Parameter  Explained  Variance 


i 

l> 


Ci 


I' 


f 


: 

i 


«: 


f 


i 


Sylvanla  Seismic 


Sylvanla  Selsmlc/Acoustlc 


Honeywell  Seismic 


Honeywell  Selsmlc/Acoustlc 


Honeywell/Sy 1 vanla 
Combined 


1 

.836551 

2 

.94553.1 

3 

.965647 

4 

.983249 

5 

.999441 

6 

.999991 

7 

1.000000 

1 

.630282 

2 

.945747 

3 

.981310 

4 

.997267 

5 

. 998974 

6 

.999512 

7 

1.000000 

1 

.538796 

2 

.791986 

3 

. 865301 

4 

.905383 

5 

.934377 

6 

.954164 

7 

.970069 

8 

.981889 

9 

.989737 

10 

.995673 

11 

.998574 

12 

1 . 000000 

1 

.393631 

2 

.595473 

3 

.722784 

4 

.782288 

5 

.835100 

6 

.874330 

7 

.932060 

8 

.928955 

9 

.948531 

10 

.901205 

11 

.972340 

12 

.981633 

13 

.98(>S)(U  ' 

14 

.991925 

15 

,995971 

16 

.997947 

17 

.999049 

18 

1.000000 

1 

.414540 

2 

.564610 

3 

.682408 

4 

.747074 

S 

.794903 

6 

.835086 

7 

.865469 

8 

. 890200 

9 

.907269 

10 

.923146 

11 

.938231 

12 

.949391 

13 

.959661 

14 

.967579 

15 

.973191 

16 

.978376 

17 

.982428 

18 

.985824 

19 

.988871 

20 

.991538 

21 

.994072 

22 

.996058 

23 

.995711 

24 

.998452 

25 

.990016 

26 

.999517 

27 

. 990823 

28 

1 .oooooo 

m 


70 


4 


) 


5.4  REDUCED  DIMENSIONALITY  CLUSTER  PLOTS 


Each  cluster  cell  in  the  original  feature  space  may  be  transformed  to 
the  (rotated  and  orthogonal)  Eigenvariable  z-space  by  Lhe  operation: 

N 

\ ^ “ki 

max 

N 

' E “ki 

min 

where  z and  z,  are  the  maximum  and  minimum  boundaries,  respec- 

^ax  %in 

tively,  of  the  cell  on  the  kth  z axis  (k=l,2,3),  and 


Uj^^  is  the  ith  Eigenvector  weight  for  the  kth  Eigenvector, 
is  the  ith  mean  value  of  the  cell  in  the  X-space, 

2^  is  the  ith  standard  deviation  of  the  cell  in  the  X-space, 
X^  is  the  mean  value  of  the  ith  feature, 

N is  the  number  of  original  features. 


Figure  5.1  shows  the  cluster  cells  froDi  the  Sylvania  seismic 
feature  sets  plotted  in  two-dimensional  Z space  for  every  pair  of 
target  classes.  Notice  that  some  classes  are  clearly  separable 
from  other  classes,  for  instance.  Class  4 is  distinct  from  Class  1 
and  Class  3.  Other  classes  are  very  close  together  but  not  over- 
lapping (at  the  one-sigma  level).  Thus,  Classes  1,  3,  and  5 are 
sufficiently  separated  to  permit  accurate  discrimination 
However,  some  of  the  classes  overlap  one  another  extensively;  c.g. , 
Classes  2 and  4,  2 and  5,  etc. 
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FIGURE  5.1:  TWO-DIMENSIOIVAL  CLVSTm  PLOTS  IN  Z SPACE  FOR  THE  SYLVANIA  FEATURE  SET 


The  clusters  shown  in  Figure  5.1  represent  the  major  groups  of  data 
for  each  target  class  (Table  5.1).  The  results  of  the  reduced- 
dimensionality  cluster  analysis  agree  well  with  the  confusion  matrices 
found  below  for  the  Sylvania  STC  using  regenerated  weights  (Table  6,8). 
For  example,  consider  the  Class  2 cluster  in  the  center  of  Class  4. 

It  can  be  seen  from  Table  6.8  that  19  of  43  Class  2 at  Grayling 
are  misclassif ied  as  Class  4 targets.  Similarly  10  of  36  Class  3 
targets  at  Ft.  Bragg  are  misclassif ied  as  Class  2.  Thus,  the 
confusion  matrix  results  are  supported  by  the  high  degree  of  over- 
lap as  shown  in  Figure  5.1.  Also,  those  classes  appearing  clearly 
separable  in  Figure  5.1  are  rarely  misclassif ied  (Table  6.8). 

A cluster  plot  was  prepared  for  the  combined  Honeywell  and  Sylvania 
feature  set  showing  cell  boundaries  along  the  first  three  Z axes. 

This  plot  is  presented  in  Figure  5.2.  The  verical  axis  denotes 
the  number  of  members  in  a given  cell.  A logarithm  scale  was 
chosen  for  plotting  ease.  The  three  Z axes  represent  approximately 
68  percent  of  the  variance  of  the  feature  set.  The  twelve  rec- 
tangles shown  correspond  to  the  merged  cluster  cells.  (Note: 
on  the  z2  axis,  the  three  PER  clusters  were  so  close  together 
they  are  shown  as  one  rectangle. ) Although  most  clusters  on  a 
single  axis  seem  to  overlap  with  those  of  another  class,  there  is 
actually  a good  degree  of  separability  when  al 1 three  axes  are 
considered.  A necessary  and  sufficient  condition  for  two  cells  to  be 
separable  iji  N dimensions  is  that  they  are  , parable  on  any  one 
of  the  N axes.  For  example,  notice  that  Cell  1 (NUS)  overlaps 
with  Cell  6 (FWA)  and  Cell  8 (WV)  on  zl , but  on  z2  it  is  separated 
from  these  cells.  Since  the  nuisance  class  only  contains  only  this 
one  cell,  this  class  is  separable  from  both  WV  and  RWA. 
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It  can  be  seen  from  Figure  5.1  that  a linear  classifier  could 
be  implemented  for  pairwise  separation  between  the  following 
classes  using  the  Sylvania  STC  features: 

TV , RWA 
TV,  NUS 
FWA,  RWA 
FWA,  NUS 
RWA,  PER 
PER,  NUS 

Thus,  a linear  classifier  could  be  used  for  separating  Class  1 
from  Class  3 and  Class  3 from  Class  5.  However,  these  clusters  are 
very  close  together,  and  slight  changes  in  the  circuit  parameter 
of  analog  circuits  could  cause  misclassif ications . The  following 
remaining  target  classes  can  only  be  separated  nonlinearly : 

TV,  WV 
TV,  PER 
WV,  FWA 
WV,  RWA 
WV,  PER 
WV,  NUS 
RWA,  NUS 


6.  CLASSIFIER  REGENERATION  AND  SYNTHESES 


6.1  INTRODUCTION 

The  Honeywell  and  Sylvania  STC  and  SATC  classifiers  have  been 
regenerated,  i.e. , optimized  vis-a-vis  the  present  field  data, 
and  five  new  classifiers  xiave  been  synthesized  by  Adaptronics, 

Inc.  The  niimber  of  sensor  channel.^,  signal  features,  and 
discriminant  functions;  and  the  type  of  discriminant  ^unction, 
decision  logic,  and  display  for  each  classifier,  are  summaried 
in  Table  6.1.  The  weights  for  all  nine  classifiers  were  com- 
puted from  an  identical  design  data  base  of  225  records  and 
evaluated  on  the  remaining  446  records.  This  provided  a common 
design  and  evaluation  data  base  for  comparing  the  performance 
characteristics  cf  the  nine  classifiers.  The  numbers  of  records 
included  in  each  class  in  the  data  bases  are  given  in  Table  6.2. 
The  records  in  the  design  set  were  selected  at  random,  and  repre- 
sent about  one-third  of  the  data  from  each  class. 

Classifiers  A,  B,  C,  and  D correspond  to  the  classifiers  simu- 
lated in  the  work  described  in  Section  3 of  the  report;  however, 
new  weighting  coefficients  were  computed  from  the  design  data 
base.  A single  set  of  coefficients  was  obtained  for  classifiers 
F and  H since  these  classifiers  differed  only  in  the  decision  logi 
and  display  method.  A single  set  of  nonlinear,  adaptive  learning 
networks  (ALN)  was  generated  for  classifiers  G and  I,  since 
these  two  differed  in  the  same  way  as  classifiers  F and  H. 

A composite  feature  set  for  each  record  was  produced  by  com- 
bining: (1)  28  selected  Sylvania  and  Honeywell  seismic  and 
acoustic  signature  features,  and  (2)  the  acoustic-to-seismic 
energy  ratio.  The  last  parameter  was  suggested  by  Dr.  Richard  K. 
Young,  USAMERDC  Project  Monitor.  Dr.  Young  had  observed  in  the 
data  collection  and  digitization  process  that  the  ratio  of 
acoustic-to-seismic  energy  showed  promising  potential  as  a class 
discrimination  parameter. 


Preceding  page  Hank 
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TABLE  6.2 

CLASS  COMPOSITION  OF  DESIGN 
AND  EVALUATION  DATA  BASES 


Class 

Design 

Evaluation 

1 

113 

225 

2 

64 

127 

3 

18 

36 

4 

12 

24 

5 

12 

22 

6 

6 

12 

TOTAL 

225 

446 
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Root  mean  square  (RMS)  values  were  obtained  for  the  two  trans- 
ducer channels  during  the  simulation  phase  of  the  project,  and 
these  were  used  to  derive  the  29th  parameter  value  for  each 
record.  The  input  RMS  values  were  reduced  to  transducer  output 
RMS  values,  and  the  logarithm  of  the  ratio  of  acoustic-to- 
seismic  energy  transducer  output  values  was  used  as  the  value 
of  the  29th  parameter. 


Classifiers  E,  F,  and  H employed  linear  functions  of  the  29 
parameters  in  their  discriminant  functions,  while  Classifiers 
G and  I employed  nonlinear  combinations  of  the  29  parameters 
for  their  discriminant  functions.  The  values  from  the  nine 
Eigenvector  transformations  associated  with  the  largest 
Eigenvalues  and  the  acoustic-to-seismic  ratio  described  above 
were  used  to  generate  the  nonlinear  discriminant  functions. 

(The  Eigenvector  analysis  of  the  Sylvania  and  Honeywell  features 
was  described  in  Section  5.1.)  Thus,  the  10  independent  variables 
used  for  the  nonlinear  discriminant  functions  of  Classifiers  G and  I 
were : 


I 

i = 1 


UiiX^ 


28 


X 


9 


i = 1 ^9i^i 


^10  ^29 


where  the  x^  are  the  29  features  while  the  x\  represent  the 
transformed  inputs  used  to  synthesize  the  nonlinear  ALN 
discriminant  functions. 
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6.2  LINEAR  "ONE  VERSUS  FIVE"  CLASSIFIERS 


Classifiers  A,  B,  C,  D,  and  E are  all  linear  "one  versus  five" 
classifiers;  that  is,  they  used  six  discriminant  functions  with 
7,  7,  12,  18,  and  29  features,  respectively.  The  discriminant 
functions  are  of  the  form: 


^i  = 


N 

I 

3 * 1 


(i  = 1,  2,  ...,  6) 


where  N is  the  number  of  features  in  the  discriminant  function. 

The  weights  in  each  function  were  computed  by  using  the  design 
data  as  input  to  a linear  regression  program.  This  program 
computed  the  regression  equations  in  a stepwise  (i.e.,  one 
variable  at-a-time)  manner.  At  each  step  an  additional  vari- 
able was  added  to  the  regression  equation.  The  variable  added 
was  the  one  which  resulted  in  the  greatest  reduction  in  the 
error  sum  of  squares.  The  added  variable  had  the  highest  partial 
correlation  with  the  dependent  variable  partialed  on  the  previously 
added  variables.  The  dependent  variable  in  all  cases  was 
assigned  a value  of  +i.o  for  the  category  of  interest. 


In  a "one  versus  five"  type  discriminant  function,  the  data 
for  category  one,  +1.0  dependent  variable  value,  were  all  from 
the  same  class;  data  for  category  tv/o,  -1.0  dependent  variable 
value,  were  records  from  the  remaining  five  classes.  (In  a "one 
versus  one"  function,  data  in  the  second  category  would  be 
selected  from  only  one  other  class.) 

For  example,  to  derive  6-2,  the  function  to  discriminate  Class  2 tar- 
gets from  targets  of  the  other  classes  (one  versus  five),  a depen- 
dent variable,  y,  was  added  to  each  design  data  record.  For  Class  2 
data,  y was  assigned  a +1.0  value,  while  for  all  other  classes 
a -1.0  was  assigned.  The  numerical  imbalance  between  the 
number  of  Class  2 data  and  the  data  of  all  other  classes  was 


corrected  by  duplicating  the  Class  2 records  until  a numerical 
balance  was  attained  betv/een  the  two  categories.  (The  five 
"one  versus  five"  discriminant  functions  were  obtained  via  the 
same  technique.)  The  weighting  coefficients  obtained  for 
classifiers  A,  B,  C,  D,  and  E are  shown  in  Tables  6.3  to  6.7 
for  the  respective  classifiers. 

The  six  "one  versus  five"  discriminant  functions  gave  each 
target  claf^s  one  opportunity  of  being  selected.  A positive 
discrimi’'  .at  function  output  was  related  to  a single  class, 
while  a negative  output  indicated  the  possibility  of  any  one  of 
the  other  five  classes  as  the  source.  The  target  class  whose  asso- 
ciated discriminant  function  output  value  was  the  maximum  of  the 
six  discriminant  function  outputs  was  selected  as  the  classified 
target.  Tables  6.8  to  6.12  are  the  confusion  matrices  obtained 
by  applications  of  the  five  classification  procedures  A,  B,  C, 

D,  and  E to  the  evaluation  data  base  (446  signatures).  Comparing 
these  results  with  Tables  3.6  to  3.9  show  a considerable  classi- 
fication accuracy  increase. 

6.3  LINEAR  "ONE  VERSUS  ONE"  CLASSIFIERS 

The  linear  "one  versus  one"  (pairwise)  discriminant  functions 
were  drived  using  the  same  techniques  as  were  used  to  derive  the 
linear  "one  versus  five"  discriminant  functions.  However,  in 
the  design  data,  only  two  classes  were  represented  at  a time 
rather  than  the  six  classes.  Since  there  were  six  classes  of 
interest,  K = 6 and  all  possible  non-repetitive  pairs  of 
classes  were  to  be  discriminated,  the  number  of  discriminant 
functions  was: 

K(K-l)  = 6(52  - ir; 

2 2 ~ 

The  classifier  architecture  is  shown  in  Figure  6.1. 
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WEIGHTING  COEFFICIENTS  FOR  REGENER'TED  SYLVANIA  STC  CLASSIFIER 
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WEIGR'^I’^G  COEFFICIENTS  FOR  REGENERATED  SYLVANIA  SATC  CLASSIFIER 
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TABLE  6.8 

CONFUSION  MATRICES  FOR  THE  SYLVANIA  STC  WITH  REGENERATED  WEIGHTS  (EVALUATION  SET) 
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Overall  Accuracy:  247/446  = .55 
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Overall  Accuracy:  301/446 


TABLE  6.10 

CONFUSION  MATRICES  FOR  THE  HONEYWELL  STC  WITH  REGENERATED  WEIGHTS  (EVALUATION  SET) 
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Overall  Accuracy:  159/446  = .36 


TABLE  6.11 

CONFUSION  MATRICES  FOR  THE  HONEYWELL  SATC  WITH  REGENERATED  WEIGHTS  (EVALUATION  SET) 
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Overall  Accuracy:  266/446  = .60 


TABLE  6.12 

CONFUSION  MATRICES  FOR  THE  ADAPTRONICS  SATC.  #1  (EVALUATION  SET) 
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Overall  Accuracy:  383/446  =*  .86 


The  decision  surface  of  each  pairwise  subclassifier  is  such 
that  one  target  class  tends  to  be  mapped  into  a fixed  value 
below  its  threshold  and  the  other  target  class  into  a fixed  value 
above.  The  usual  convention  is  that  a pairwise  discriminant 
function  attempts  to  map  all  class  i members  onto  the  number 
+1.0  and  all  class  j members  onto  the  number  -1.0,  with  the 
discrimination  threshold  set  midway  between  these  two  values, 
i.e.,  set  equal  to  zero. 

In  a pairwise  test,  the  proximity  of  the  computed  discriminant 
function  output  to  one  of  the  number  +1  and  -1  (i.e.,  the  expected 
outputs)  governs  the  decision  — the  threshold  represents  the 
point  of  uncertainty.  The  closer  the  output  is  to  either  +1 
or  -1  (using  a suitable  metric  such  as  squared  normalized 
difference),  the  greater  the  confidence  that  can  be  placed  in  the 
consequent  decision.  A tie-breaking  strategy  that  exploits 
this  confidence  information  is  illustrated  by  means  of  the 
following  example. 

Table  6.13  contains  the  hypothetical  outputs  of  the  15  pair- 
wise tests  for  one  10-second  record.  It  can  be  seen  that  with  a 
threshold  equal  to  zero,  a positive  output  renders  a unit  "vote" 
for  Class  i and  vice  versa  for  a negative  output..  (The  value 
"i"  is  always  less  than  "j").  In  this  illustrative  example. 
Classes  1 and  2 are  tied  with  four  votes  each.  Classes  3,  4, 

5,  and  6 are  eliminated  from  further  consideration. 


TABLE  6.13 

ILLUSTRATION  OF  TIE-BREAKING  STRATEGY 


N No. 

Class  i 

Versus  Class  .1 

Output 

1 

1 

vs. 

2 

+1.01 

2 

1 

vs. 

3 

+0.91 

3 

1 

vs. 

4 

-0.13 

4 

1 

vs. 

5 

+0.85 

5 

1 

vs . 

6 

+ 1.15 

6 

2 

vs . 

3 

+0.69 

7 

2 

vs. 

4 

+0.71 

8 

2 

vs. 

5 

+ .87 

9 

2 

vs . 

6 

-0.85 

10 

3 

vs. 

4 

-0.88 

11 

3 

vs. 

5 

+0.92 

12 

3 

vs . 

6 

+1.00 

13 

4 

vs. 

5 

-0.78 

14 

4 

vs. 

6 

+0.91 

15 

5 

vs . 

6 

+0.93 

Winning  Class 

1 

1 

4 

1 

1 

2 

2 

2 

2 

4 
3 

3 

5 

4 

5 


Voting  Logic 
Target  Class 

1 

2 

3 

4 

5 

6 


No.  Votes 
4 
4 
2 
3 
2 
0 
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The  following  measure  of  confidence  may  be  used  in  the  case 
of  ties : 


K(K-l)/2 

I 

m = 1 


m 


1 “ ! k, 


where 


K 

K.  = 


V 

m 


Number  of  classes 
Actual  output  for  Class  K 

"Selection  operation"  Vj^  = 0 if  Class  k is  not 
involved  in  the  mth  test  or  if  k is  involved 


but  loses;  = 1 if  Class  k is  involved  in  m 
m 

and  wins. 


th 


test 


"H 


I 


1 M.  = 

1-1.01 

+ 

1-0. 9l|  + 

1-0.85 

+ 

1-1.15 

r 

1 

*^2  = 

1-0.69 

+ 

1-0. 71 1 + 

1-0.87 

+ 

1-0.85 

is  equal  to  zero  if  the  actual  outputs,  k^,  always  equal 
unity.  Larger  values  of  usually  denote  weaker  decisions. 
Therfore,  a tie-breaking  strategy  is  to  evaluate  for  those 
classes  k in  contention  and  to  choose  that  class  for  which  the 
value  is  smallest. 

Continuing,  for  the  example  given  in  Table  6.13,  the  associated 
and  Mg  values  for  the  tied  Classes  1 and  2 are: 


= 0.40 


Therefore,  Class  1 is  the  classified  target  due  to  its  obtaining 
the  larger  degree  of  confidence. 

The  coefficients  of  the  15  linear  discriminant  functions  are 
shown  in  Table  6.14. 
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LINEAR  PAIRWISE  WEIGHTING  COEFFICIENTS  FOR  THE  COMBINED  29-FEATURE  SET 
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TABLE  6.14 
(Continued) 
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Table  6.15  presents  results  obtained  wit  a Classifier  F for  the 
data  in  the  evaluation  subset.  This  classifier  employs  the 
"one  versus  one"  architecture  with  the  above  tie-breaking 
procedure.  The  discriminant  functions  are  linear. 

As  an  alternative  to  tie-breaking,  it  may  be  desirable  to 
report  all  classes  receiving  at  least  V votes.  Table  6.16 
presents  the  results  for  Classifier  H,  which  also  uses  "one 
versus  one"  s.'r hitectur e and  linear  discriminant  functions. 

The  classifie'.:  --s  regarded  as  having  prodiiced  a correct  response 

whenever  it  g\;ie rated  at  least  four  votes  (V  = 4)  for  the  true 
class.  With  this  classifier,  the  following  vote  tallies  are 
obtained : 

• 4 correct  votes  reported  55  times  out  of  446  cells 
(12.3  percent) 

• 5 correct  votes  reported  344  times  out  of  146  cells 
(77.1  percent) 

Thus,  at  least  four  votes  were  received  for  the  correct  class 
on  399  records  out  of  446  in  the  evaluation  data  subset,  or  on 
89.5  percent  of  the  evaluation  records. 

It  is  also  noteworthy  that  when  it  reported  five  votes  for  a 
single  class.  Classifier  H was  correct  on  344  out  of  380  records 
or  90.5  percent  of  the  time. 
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TABLE  6.15 

CONFUSION  MATRICES  FOR  THE  ADAPTRONICS  SATC  (EVALUATION  SET) 


Overall  Accuracy:  381/446  - .85 


TABLE  6.16 

CONFUSION  MATRICES  FOR  THE  ADAPTRONICS  SATC  #4  (EVALUATION  SET) 
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Overall  Accuracy:  399/446  = .89 


6.4  NONLINEAR  "ONE  VERSUS  ONE"  CLASSIFIERS 


Nonlinear  pairwise  ("one  versus  one")  discriminant  functions 
have  been  synthesized  by  combining  pairs  of  inputs,  and  , into 
building-block  polynomial  elements  according  to  the  equation 

y * Wq  + + WjXj  + W3X1XJ  + W4X?  + WgX^ 

A nonlinear  discriminant  function  may  consist  of  layers  of  such 
elements  combined  to  model  a given  dependent  variable.  Each  layer 
may  consist  of  as  many  elements  as  the  number  of  pairwise  com- 
binations of  the  input  parameters  processed  by  that  layer,  but 
only  the  most  discriminating  elements  need  be  retained.  These 
elements  may  then,  in  turn,  be  used  as  inputs  to  the  next  layer 
of  the  network.  Reference  2 gives  a concise  explanation  of 
learning  network  theory  and  applications. 


The  Eigenvalue  Analyses  (Section  5.3)  showed  that  a large  per- 
centage of  the  data  variance  for  the  combined  feature  set  could 
be  explained  or  represented  with  a reduced  number  of  new  ortho- 
gonal "Z"  variables.  Taking  advantage  of  this  fact,  only  ten 
features  were  used  to  train  the  15  nonlinear  discriminant  func- 
tions. The  first  nine  Z variables  (of  the  28  combined  features), 
representing  90  percent  of  the  data  variance,  plus  the  acoustic 
to  seismic  energy  ratio  (mentioned  above)  as  the  tenth  feature. 

In  effect,  all  28  Honeywell  and  Sylvania  features  are  represer  ^,er* 
in  the  nonlinear  classifiers.  The  ith  Z variables  are  given  by: 


28 


Z. 

1 


j=l 


u.  .X. 
ij  J 


where  the  . . are  the  28  Eigenvector  weights  for  the  ith  z vari- 
able  and  the  x,  are  the  28  Honeywell  and  Sylvania  features. 


Appendix  D gives  the  Eigenvector  weighting  coefficients  for  the 
first  nine  Z variables,  and  the  structures  of  the  15  nonlinear 
discriminant  functions  which  have  been  synthesized.  The  weighting 
coefficients  are  shown  for  each  pairwise  discriminator. 

Two  sets  of  confusion  matrices  have  been  generated  for  the  non- 
linear "one  versus  one"  classifier.  The  first  set,  shown  in 
Table  6.17,  was  obtained  by  application  of  the  tie-breaking 
decision  logic;  and  the  second  set,  shown  in  Table  6,18,  was 
obtained  by  the  vote-reporting  technique,  as  described  above. 

The  misclassif ications  have  been  tabulated  for  the  nonlinear 
classifier  using  the  tie-breaking  decision  logic  (G)  and  are 
shown  in  Table  D.2  of  Appendix  D.  The  letters  "D"  and  "E"  ir. 
this  table,  which  appear  under  header  word  "SET,"  indicate  which 
signatures  were  used  for  "Design"  or  "Evaluation"  of  the  classi- 
fier. Range  is  given  in  meters  for  tracked  and  wheeled  vehicles. 

Figure  D.16  indicates  how  the  nonlinear  classifier  performed  as  a 
function  of  range  for  tracked  and  wheeled  vehicles.  In  the 
figure,  the  blank  bars  show  the  distribution  of  signatures  for 
the  two  classes  as  a function  of  range  from  the  sensor.  Super- 
imposed on  each  blank  bar  is  the  number  of  misclassif ications 
made  for  the  appropriate  class.  It  can  be  seen  from  this  diagram 
that  the  relative  number  of  misclassif ications  is  reasonably 
independent  of  the  range  between  target  and  sensor.  Although  only 
a few  signatures  were  available  at  high  ranges,  no  misclassif i- 
cations  were  made  for  tracked  vehicles  beyond  600  meters. 
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TABLE  6.17 

CONFUSION  MATRICES  FOR  ADAPTRONICS  SATC  #3,  (EVALUATION  SET) 
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Overall  Accuracy:  377/446  = .85 


TABLE  6.18 

CONFUSION  MATRICES  FOR  THE  ADAPTRONICS  SATC  #5  (EVALUATION  SET) 
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Overall  Accuracy:  390/446  = .87 


7.  COMPARISON  OF  CLASSIFIER  RESULTS 


In  evaluating  the  performance  of  a classifier,  three  criteria 
should  be  taken  into  consideration.  These  criteria  reflect  the 
ability  of  a classifier  to  perform  both  accurately  and  consistently. 
Thus  the  performance  of  the  classifier  is  herein  defined  as  the 
product  of  three  metrics;  the  classifier  accuracy  (A),  the 
consistency  of  the  classifier  accuracy  (C),  and  the  degree  of 
site  independence  of  the  classifier  (S).  These  quantities  were 
explained  in  Section  1.  The  performance  of  the  nine  classifiers 
were  computed  from  the  confusion  matrices  of  Section  6.  The 
results  are  shown  in  Table  7.1.  In  addition,  the  class  accuracies 
of  all  nine  classifiers  have  been  plotted  in  Figure  7.1.  (The 
abscissa  of  this  plot  is  non-Euclidian. ) 

The  performance  of  the  nine  classifiers  demonstrates  that  a sig- 
nificant increase  occurs  when  the  combined  set  of  29  parameters 
is  utilized.  (It  was  observed  in  the  discrimination  function 
generation  procedure  that  the  acoustic-to-seismic  energy  ratic 
was  one  of  the  first  parameters  to  be  selected  in  the  linear 
discriminant  functions,  and  it  was  selected  as  a kej  parameter 
in  10  of  the  15  nonlinear  ALN  discriminant  functions.)  Classifiers 
using  all  29  parameters,  whether  in  "one  versus  fjve"  or  "one 
versus  one"  discriminant  functions,  all  achieve  accuracies  in  the 
85  percent  range.  A further  increase  in  classifier  perfonr:'.nce 
is  obtained  when  the  alternative  method  of  reporting  ties  is  used. 

The  consistency  factor,  C,  improved  with  the  addition  of  the 
acoustic  parameters  to  the  Sylvania  and  Honeywell  seismic  para- 
meters, and  improved  again  as  the  classifiers  using  --  combined 
29  features  were  evaluated.  The  additional  of  the  acoustJr  para- 
meters also  resulted  in  a decrease  of  the  site  dependencj . 


Preceding  page  Mank 
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TABLE  7.1 

PERFORMANCE  RANK-ORDERING  OF  NINE  CLASSIFIERS 


^rH^HOOOeOOlO 

wiAO(OCOC40U>lO 


J CO 

a 

0)  •> 
0)  0.0; 
■P  0)  o 
•H  *0  C5 
CQ  a 0) 
•H  *dl 


00 

o 

'O* 

o 

o 

00 

CO 

Oi 

CO 

o 

t- 

o 

H 

t- 

m 

o> 

<Si 

00 

00 

00 

00 

tn 

CO 

sn 

lA 

<£> 

00 

CO 

o 

Oi 

CO 

00 

CO 

to 

CO 

H 

o: 

Oi 

cn 

00 

(Si 

00 

00 

00 

rH  O 
H cO 

to 

^ 05 

CO 

lA 

oi  ^ 

o> 

IQ  ,lO 

05 

lA 

lO 

P 3 <! 

00 

00 

00 

00  * 00 

lA 

CO 

•A 

CO 

0)  O 

• 

m 

« 

• • 

> O 

o<«s 

lA 

CO 

Ci 

H 

% 

=«k 

o 

U 

o 

o 

O 

irt 

< 

< 

<0 

o 

CO 

CO 

CO 

CO 

CO 

E-* 

u 

o 

<5 

tr* 

a 

H 

CO 

m 

CO 

(0 

(0 

CO 

< 

Eh 

CO 

o 

o 

o 

o 

C5 

CO 

ra 

•H 

•H 

•H 

•H 

P 

H 

rH 

a 

e 

a 

ti 

a 

P 

c4 

cO 

P 

o 

o 

p 

p 

0 

a> 

P 

p 

0> 

?■) 

p 

d 

a 

» 

•p 

•p 

•p 

P 

p 

n 

(4 

>, 

9* 

O. 

<u 

> 

> 

0) 

cd 

cO 

cO 

(4 

fl 

p 

P 

fl 

•d 

•d 

•d 

•d 

•d 

0 

>» 

{*» 

0 

<5 

< 

< 

<e 

< 

» 

CO 

CO 

n 

PERFORMANCE 


As  indicated  in  Table  7.1,  the  highest  accuracy  and  highest 
performance  attained  were  produced  by  classifier  H utilizing 
all  29  features  in  "one  versiis  one"  linear  discrimination 
functions  — reporting  all  classes  receiving  at  least  four  votes. 
The  accuracy  of  this  classifier  is  approximately  90  percent 
and  its  performance  is  approximately  0.8. 
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8.  CONCLUSIONS  AND  RECOMMENDATIONS 


8.1.  CONCLUSIONS 


A detailed  study  has  been  performed  of  the  REMBASS  six-class 
seismic/acoustic  target  classification  problem.  It  has  been 
demonstrated  that  a six-way  classifier  can  be  realized  that, 
in  simulations,  exhibits  improved  overall  accuracy,  improved 
site  independence  and  improved  class  invariance,  and  improved 
range  invariance.  The  specific  conclusions  reached  in  the 
course  of  this  study  are: 


1.  An  average  single  epoch  classification  accuracy 

of  85  percent  can  be  realized  with  a practicable  design. 

2.  The  above  accuracy  is  achieved  with  high  consistency 
at  different  sites  and  for  the  different  target 
classes,  and  the  classifier  is  relatively  insensitive 
to  target  range  (out  to  the  periphery  of  the  target 
detection  zone)  and  the  speed,  altitude  (where 
applicable),  and  heading  of  the  target. 

3.  If  the  combined  set  of  28  features  from  prior 
Honeywell  and  Sylvania  designs  is  used  with  an 
additional  acoustic/seismic  energy  ratio  -^eature, 
the  different  classes  of  targets  are  separable 
using  linear  discriminant  functions.  Nonlinear 
discriminant  functions  offer  possibilities  for  using 
reduced  feature  sets. 

4.  By  utilizing  a pairwise  voting  logic  structure,  the 
classifier  circuitry  is  potentially  less  prone  to 
manufacturing  tolerance  errors  and  to  parameter  drift. 

5.  Using  vote  reporting  in  lieu  of  class  reporting,  the 
voting  structure  is  also  suitable  for  multi-target 
classifications.  Furthermore,  the  likelihood  of 
intentional  or  unintentional  jamming  of  the  sensor 
is  reduced,  and  the  user  has  greater  opportunity  to 
exercise  judgment  concerning  the  tactical  situation. 

6.  Further  work  is  needed  to  develop  the  most  cost- 
effective  classifier  design.  As  a foundation  for  this 
work,  additional  field  and/or  synthetic  data  should  be 
obtained  so  as  to  represent  more  fully  the  wide 
variety  of  targets  and  terrain  conditions  that  could  be 
encountered  by  an  operational  system. 
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8.2  RECOMMENDATIONS 


It  iK  recommended  that  the  following  further  investigations  be 
performed : 

1.  Detail  the  range  capabilities  of  any  newly  designed 
classifiers,  by  computing  different  confusion  matrices 
as  a function  of  target  range. 

2.  Estimate  the  expected  accuracy  and  performance  of  each 
classifier  on  the  basis  of  multi-epoch  averaging, 
i.e.,  calculate  expected  performance  versus  nvimber 

of  epochs  averaped.  This  will  evaluate  each  classifier 
on  a target  rug  rather  than  a target  partial  run  basis. 

3.  Compare  the  cluster  structures  of  seismic/acoustic 
signatures  obtained  from  foreign  and  domestic  vehicles. 

If  there  is  a pronounced  difference,  incorporate  the 
foreign  vehicle  data  into  the  data  base  and  retrain/ 
re-evaluate  the  classifiers. 

4.  Compare  cluster  structures  of  synthetically-generated 
seismic/acoustic  signatures  (based  upon  assumed  terrain 
conditions)  with  known  clusters  in  the  existing  field 
data  records.  If  agreement  is  satisfactory,  incorporate 
synthetic  data  for  sites  not  represented  by  field  records 
into  the  data  base  and  retrain/re-evaluate  the  classifiers. 

5.  Identify  optimal  number  and  type  of  features;  determine 
if  fewer  than  29  features  can  be  used  without  sacrificing 
classifier  performance.  Investigate  trade-off  between 
numbers  of  features  required  and  degrees  of  nonlinearity 
of  the  classifier  discriminant  functions.  (Fewer  features 
are  needed  when  using  nonlinear  discriminant  functions 
within  a given  classifier  architecture.) 

6.  Investigate  the  relative  merits  of  "one  versus  five" 
maximum  selection,  "one  versus  one"  voting,  and  possible 
"one  versus  five"  voting.  The  last  would  probably  be 
competitive  in  accuracy  and  consistency  with  "one  versus 
one"  voting,  and  would  require  less  circuitry,  but  these 
circuits  could  be  more  prone  to  instability  than  those 
for  "one  versus  one"  voting. 

7.  Investigate  use  of  confidence-weighted  voting  wherein 

a subclassifier  producing  an  output  that  is  numerically 
close  to  the  expected  output  for  a given  class  votes 
more  strongly  for  that  class  than  when  its  output  is 
far  from  the  expected  output. 

8.  Investigate  multi-target  classifications  using  the  vote 
reporting  concept. 
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1.  J 

NUH 

MERDCIO 

CLASS 

TYPE 

SITE 

SPEED 

STAKE 

A/S  GAIN 

1 

469 

6 

N 

GRAYLING 

-0 

-0 

50  70 

2 

469 

6 

N 

GRAYLING 

-0 

-0 

50  70 

3 

470 

6 

N 

GRAYLING 

-0 

-0 

50  70 

4 

471 

6 

N 

GRAYLING 

-0 

-0 

50  70 

5 

472 

6 

N 

GRAYLING 

-0 

-0 

50  70 

6 

473 

6 

N 

GRAYLING 

-0 

-0 

50  70 

V 

7 

474 

6 

N 

GRAYLING 

-0 

-0 

50  70 

8 

495 

6 

N 

GRAYLING 

-0 

-u 

60  70 

9 

496 

6 

N 

GRAYLING 

-0 

-0 

60  70 

'• 

10 

497 

6 

N 

GRAYLING 

-0 

-0 

60  70 

11 

498 

6 

N 

GRAYLING 

-0 

-0 

60  70 

12 

553 

6 

N 

FT. BRAGG 

-0 

-J 

30  70 

13 

554 

6 

N 

FT. BRAGG 

-0 

-0 

30  70 

14 

5 35 

6 

N 

YUMA 

-0 

-0 

50  70 

15 

566 

6 

N 

YUMA 

-0 

-0 

50  70 

c 

16 

567 

6 

N 

YUMA 

-0 

-0 

50  70 

17 

566 

6 

N 

YUMA 

-0 

-0 

50  70 

18 

569 

6 

N 

YLMA 

-0 

-0 

50  70 

c 

19 

602 

5 

HI 

YUMA 

3 

13 

70  70 

20 

603 

5 

HI 

YUMA 

3 

10 

70  70 

21 

604 

5 

HI 

YUMA 

3 

7 

70  70 

22 

60  5 

5 

HI 

YUMA 

3 

6 

70  70 

23 

606 

5 

HI 

YUMA 

3 

11 

70  70 

24 

608 

3 

H3 

YUMA 

3 

8 

60  70 

C' 

25 

6u9 

5 

H3 

YUMA 

3 

12 

60  70 

26 

610 

5 

H3 

YUMA 

3 

14 

60  70 

27 

611 

5 

H3 

YUMA 

3 

11 

60  70 

w 

26 

612 

5 

H3 

YUMA 

3 

-0  • 

60  70 

29 

614 

5 

H3 

YUMA 

3 

5 

60  70 

30 

615 

5 

H3 

YUMA 

3 

7 

60  70 

c 

31 

616 

5 

H3 

YUMA 

3 

11 

60  70 

32 

61  7 

5 

H3 

YUMA 

3 

14 

60  70 

33 

618 

5 

H3 

YUMA 

3 

11 

60  70 

o 

34 

619 

5 

H3 

YUMA 

3 

8 

60  70 

35 

62; 

5 

HI 

YUMA 

3 

5 

60  70 

36 

621 

5 

HI 

YUMA 

3 

8 

60  70 

w 

37 

622 

5 

HI 

YUMA 

3 

11 

60  70 

38 

623 

5 

HI 

YUMA 

3 

13 

60  70 

39 

624 

5 

HI 

YUMA 

3 

10 

60  70 

'w 

40 

625 

5 

H3 

YUMA 

3 

5 

60  70 

41 

62  6 

5 

H3 

YUMA 

3 

7 

60  70 

42 

626 

5 

H3 

YUMA 

3 

12 

60  70 

43 

629 

5 

H3 

YUMA 

3 

-u 

60  70 

44 

630 

5 

H3 

YUMA 

3 

13 

60  70 

45 

631 

5 

H3 

YUMA 

3 

11 

69  70 

' 

46 

632 

5 

H3 

YUMA 

3 

7 

60  70 

47 

633 

5 

H5 

YUMA 

3 

15 

6C  70 

46 

634 

5 

H5 

YUMA 

3 

12 

60  70 

. ' 

49 

635 

5 

H5 

YUMA 

3 

10 

60  73 

50 

63  7 

5 

H5 

YUMA 

3 

14 

60  70 

Preceding  page  Hank 


direction 


N-S 

N-S 


N-S 

N-S 

N-S 

S-N 

S-N 

S-N 

S-N 

N-S 

N-S 

N-S 

S-N 

S-N 

S-N 

N-S 

N-S 

N-S 

S-N 

S-N 

S-N 

N-S 

N-S 

S-N 

S-N 

S-N 

N-S 

N-S 

N-S 

N-S 

S-N 

S-N 

S-N 

N-S 


a 


0 

NUH 

MERDCIO 

CLASS 

TYPE 

SITE 

SPEED 

STAKE 

A/S  GA1^ 

DIRECTION 

0 

51 

638 

5 

H5 

YUMA 

3 

12 

60  70 

N-S 

SZ 

639 

5 

H5 

YUMA 

3 

9 

60  70 

N-S 

M 

53 

66  9 

4 

UH-1 

FT. BRAGG 

80 

200 

40  70 

W 

54 

669 

4 

UH-1 

FT. BRAGG 

80 

200 

40  70 

55 

670 

4 

UH-1 

FT. BRAGG 

80 

200 

40  70 

M 

56 

670 

4 

UH-1 

FT. BRAGG 

80 

200 

40  70 

57 

67  0 

4 

UH-1 

FT. BRAGG 

80 

200 

40  70 

58 

671 

4 

UH-1 

FT. BRAGG 

100 

200 

40  70 

0 

59 

671 

4 

UH-1 

FT. BRAGG 

100 

200 

40  70 

60 

671 

4 

UH-1 

FT. BRAGG 

100 

200 

40  70 

51 

672 

4 

UH-1 

FT. BRAGG 

IOC 

200 

40  70 

m 

62 

673 

4 

UH-1 

FT. BRAGG 

6C 

400 

40  70 

* • - . . . 

63 

673 

4 

UH-1 

FT. BRAGG 

60 

400 

40  70 

64 

673 

4 

UH-1 

FT. BRAGG 

60 

400 

46  70 

" • 

65 

674 

4 

UH-1 

FT. BRAGG 

60 

400 

40  70 

%0 

66 

6 74 

4 

UH-1 

FT. BRAGG 

60 

400 

40  70 

5^ 

675 

4 

UH-1 

FT.BPAGG 

80 

400 

40  70 

ff 

68 

675 

4 

UH-1 

FT. BRAGG 

80 

400 

40  70 

69 

676 

4 

UH-1 

FT. BRAGG 

80 

400 

40  70 

70 

676 

4 

UH-1 

FT. BRAGG 

80 

400 

40  70 

G 

71 

677 

4 

UH-1 

FT. BRAGG 

100 

'400 

40  70 

72 

677 

4 

UH-1 

ft. BRAGG 

103 

4u0 

40  70 

73 

678 

4 

UH-1 

FT. BRAGG 

100 

400 

40  70 

C» 

74 

678 

4 

UH-1 

FT. BRAGG 

ICO 

400 

40  70 

75 

679 

4 

UH-1 

FT. BRAGG 

60 

600 

40  70 

76 

679 

4 

UH-1 

FT. BRAGG 

60 

600 

40  70 

G 

77 

680 

4 

UH-1 

FT. BRAGG 

60 

600* 

40  70 

78 

680 

4 

UH-1 

FT. BRAGG 

63 

600 

40  70 

79 

689 

4 

UH-1 

FT. BRAGG 

60 

600 

40  7C 

8C 

631 

4 

UH-1 

FT. BRAGG 

83 

600 

40  70 

81 

631 

4 

UH-1 

FT.  BRAGG 

80 

600 

40  70 

82 

682 

4 

UH-1 

ft. BRAGG 

80 

600 

40  70 

83 

682 

4 

UH-1 

FT. BRAGG 

83 

60u 

40  70 

84 

683 

4 

UH-1 

FT.BPAGG 

ICO 

600 

40  70 

85 

683 

4 

UH-1 

FT. BRAGG 

100 

600 

40  70 

86 

684 

4 

UH-1 

FT. BRAGG 

100 

600 

40  70 

87 

684 

a 

UH-1 

FT. BRAGG 

100 

600 

4 0 76 

88 

684 

4 

UH-1 

FT. BRAGG 

100 

640 

4C  70 

89 

640 

3 

TA-4 

FT. BRAGG 

253 

200 

4li  70 

90 

641 

3 

TA-4 

FT.3RAGG 

250 

200 

40  70 

91 

642 

3 

TA-4 

FT. BRAGG 

300 

200 

23  70 

o 

92 

642 

3 

TA-<» 

FT. BRAGG 

300 

200 

23  70 

93 

642 

3 

TA-4 

FT.  BRAGG' 

300 

20u 

23  70 

94 

643 

3 

TA-4 

FT. BRAGG 

303 

240 

23  70 

95 

644 

3 

TA-4 

FT.BPAGG 

450 

200 

23  70 

96 

644 

3 

TA-4 

FT. BRAGG 

450 

20j 

23  70 

97 

645 

3 

TA-4 

FT.BPAGG 

453 

240 

23  70 

98 

645 

3 

TA-4 

FT. BRAGG 

45u 

200 

23  70 

99 

646 

3 

TA-4 

FT. BRAGG 

250 

400 

23  70 

100 

646 

3 

TA-4 

FT. BRAGG 

250 

4C0 

23  70 

A- 5 


T 


# 


I 


« 

NUM 

MEROCID 

CLASS 

TYPE 

SITE 

SPEED 

STAKE 

A/S  GAIN 

DIRECTION 

# 

151 

390 

2 

H151 

YUHA 

22 

9 

50  70 

E-M 

152 

391 

2 

H151 

YUHA 

22 

10 

50  70 

E-H 

A 

153 

392 

2 

M151 

YUMA 

22 

11 

50  70 

M-E 

m 

I5<i 

393 

2 

M151 

YUMA 

22 

10 

50  70 

W-c 

155 

394 

2 

M151 

YUMA 

31 

9 

50  70 

E-N 

A 

156 

395 

2 

M151 

YUMA 

31 

11 

50  73 

E*N 

m 

157 

396 

2 

M151 

YUMA 

31 

11 

50  70 

H-E 

158 

397 

2 

M151 

YUMA 

31 

8 

50  70 

Ho£ 

A 

159 

398 

2 

T2.5 

YUMA 

6 

-0 

46  70 

H-E 

9 

160 

399 

2 

T2.5 

YUMA 

6 

-0 

46  70 

N»£ 

161 

400 

2 

T2.5 

YUMA 

6 

-0 

46  70 

H-£ 

A 

162 

401 

2 

T2.5 

YUMA 

6 

12 

46  70 

H-E 

9 

163 

402 

2 

T2.5 

YUHA 

6 

11 

46  70 

M-E 

16<* 

403 

2 

T2.5 

YUMA 

6 

10 

46  70 

N-E 

A 

165 

404 

2 

T2.5 

YUHA 

16 

-0 

40  60 

E-H 

9 

166 

405 

2 

T2.5 

YUMA 

16 

9 

40  60 

E-H 

167 

406 

2 

T2.5 

YUMA 

16 

11 

40  60 

E-H 

168 

408 

2 

T2.5 

YUMA 

16 

11 

40  60 

H-E 

9 

169 

409 

2 

T2.5 

YUMA 

16 

-3 

40  60 

W-E 

17C 

411 

2 

T2.5 

YUMA 

22 

9 

40  70 

E-H 

A 

171 

412 

2 

T2.5 

YUMA 

22 

12 

40  70 

c-H  ' 

9 

172 

413 

2 

T2.5 

YUMA 

22 

-0 

40  70 

H-E 

173 

414 

2 

T2.5 

YUMA 

22 

-0 

40  70 

H-E 

9 

.174 

415 

2 

T2.5 

YUMA 

22 

»3  ■ 

40  70 

H-E 

9 

17^ 

416 

2 

T2.5 

YUMA 

31 

4 

40  70 

E-H 

176 

41  7 

2 

T?.5 

YUMA 

31 

-3 

40  70 

E-H 

m 

177 

418 

2 

T2.5 

YUMA 

31 

15 

40  70 

K-E 

9 

178 

419 

2 

T2.5 

YUMA 

31 

12 

40  70 

H-E 

179 

42  0 

2 

T2,5 

YUMA 

31 

8 

40  70 

H-E 

A 

18(1 

422 

,2 

M715 

YUMA 

6 

10 

50  70 

E-M 

9 

181 

423 

2 

M715 

YUMA 

6 

-0 

50  70 

E-H 

182 

424 

2 

M715 

YUMA 

6 

12 

50  70 

H-E 

183 

425 

2 

M715 

YUMA 

6 

11 

50  70 

H-E 

♦/ 

184 

426 

2 

M715 

YLMA 

6 

10 

50  70 

H-E 

185 

42  7 

2 

M715 

YUMA 

16 

6 

46  70 

E-H 

I3v5 

42  8 

2 

M715 

YUMA 

16 

8 

46  70 

E-H 

9 

187 

429 

2 

M715 

YUMA 

16 

10 

46  70 

E-H 

188 

430 

2 

M715 

YUMA 

16 

13 

46  70 

H-E 

9 

189 

431 

2 

M715 

YUMA 

16 

11 

46  70 

H-c 

19(i 

432 

2 

M715 

YUMA 

16 

9 

46  70 

H-E 

191 

43-' 

2 

M715 

YUMA 

22 

7 

46  70 

E-H 

•> 

192 

434 

2 

M715 

YUMA 

22 

9 

46  70 

E-H 

193 

435 

2 

M715 

YUMA 

22 

11 

46  70 

E-H 

194 

436 

2 

M715 

YUMA 

22 

13 

46  70 

H-E 

195 

437 

2 

M715 

YUMA 

22 

11 

46  70 

H-E 

196 

435 

2 

M715 

YUMA 

22 

9 

46  70 

H-E 

197 

440 

2 

M792 

YUMA 

6 

8 

46  70 

E-H 

198 

441 

2 

M792 

YUMA 

6 

9 

46  70 

E-H 

199 

442 

2 

M792 

YUMA 

6 

10 

46  70 

E-H 

^ • 

200 

2 

M792 

YUMA 

6 

xl 

46  70 

H-E 

A-6 


• 

M 

) 

] 

NUM 

MEROCIO 

CLASS 

TYPE 

SITE 

SPEED 

STAKE 

A/S  GAIN 

direction 

201 

444 

2 

M792 

YUMA 

6 

10 

<*6  70 

H-E 

202 

445 

2 

M792 

YUMA 

6 

9 

46  70 

h-e 

203 

446 

2 

M792 

YUMA 

ib 

7 

46  70 

E-H 

20<i 

447 

2 

M792 

YUMA 

lb 

8 

46  70 

E-W 

205 

448 

2 

M792 

YUMA  . 

16 

9 

46  70 

E-H 

206 

449 

2 

M792 

YUMA 

16 

10 

46  70 

E-H 

207 

450 

2 

M792 

YUMA 

16 

13 

46  70 

208 

451 

2 

M792 

YUMA 

16 

11 

46  70 

H-E 

209 

452 

2 

M792 

YUMA 

16 

b 

46  70 

E-H  1 

210 

453 

2 

M792 

YUMA 

16 

8 

46  70 

E-K 

211 

454 

2 

M792 

YUMA 

16 

9 

46  70 

E-H  1 

212 

455 

2 

M792 

YUMA 

16 

10 

46  70 

E-H  I 

. 213 

456 

2 

M792 

YUMA 

22 

6 

40  70 

E-H  1 

21<i 

457 

2 

M792 

YUMA 

22 

8 

40  70 

E-H  1 

215 

459 

2 

M792 

YUMA 

22 

11 

40  70 

E-W  1 

216 

4o0 

2 

M792 

YUMA 

22 

13 

40  70 

H-E  1 

217 

461 

2 

M792 

YUMA 

22 

11 

40  70 

W-c  1 

218 

462 

2 

M792 

YUMA 

22 

9 

40  70 

H-E 

219 

463 

2 

M792 

YUMA 

31 

5 

40  70 

E-H  1 

220 

4 64 

2 

M792 

YUMA 

31 

8 

40  70 

P-H  1 

221 

465 

2 

M792 

YUMA 

31 

11 

40  70 

E-H 

222 

466 

2 

M792 

YUMA 

31 

14 

40  70 

H-E  1 

223 

467 

2 

M792 

YUMA 

31 

12 

40  70 

H-E  t 

22^4 

468 

2 

M792 

YUMA 

31 

9 

40  70 

H-E  j 

225 

475 

2 

H151 

grayling 

6 

-0 

50  70 

226 

476 

2 

M151 

GRAYLING 

6 

-0 

50  70 

S-N  3 

227 

477 

2 

M151 

GRAYLING 

6 

-0‘ 

50  70 

S-N  1 1 

228 

47  8 

2 

M151 

GRAYLING 

6 

-0 

50  70 

N-S  ! 1 

229 

47  5 

2 

M151 

GRAYLING 

6 

-0 

50  70 

N-S  1 

230 

480 

2 

M151 

GRAYLING 

16 

-0 

50  70 

S-M  j 

231 

481 

2 

M151 

GRAYLING 

16 

-0 

50  70 

I!*5  i 

232 

482 

2 

M151 

GRAYLING 

16 

-0 

50  70 

N-S  1 

233 

483 

2 

M151 

GRAYLING 

16 

“0 

5U  70 

N-S  1 

23i« 

484 

2 

M151 

GRAYLING 

22 

-0 

60  70 

1 j 

235 

485 

2 

H151 

GRAYLING 

22 

-0 

60  70 

236 

486 

2 

M151 

GRAYLING 

22 

-0 

60  70 

237 

487 

2 

M151 

GRAYLING 

22 

-0 

60  70 

N-S  1 

238 

488 

2 

M151 

GRAYLING 

22 

-0 

60  70 

N-S  1 

239 

489 

2 

M151 

GRAYLING 

31 

0 

60  70 

S-N  1 

2<»0 

490 

2 

M151 

GRAYLING 

31 

2 

60  70 

S-N  i 

2^1 

491 

2 

M151 

GRAYLING 

31 

5 

60  73 

S-N  i 

242 

492 

2 

M151 

GRAYLING 

31 

8 

60  70 

N-S  ■ J 

243 

493 

2 

M151 

GRAYLING 

31 

5 

60  70 

N-S  ] 

244 

494 

2 

M151 

GRAYLING 

31 

2 

60  70 

N-S 

^ 8 

245 

499 

2 

T2.5 

GRAYLING 

6 

1 

40  70 

24C 

510 

2 

T2.5 

grayling 

6 

2 

40  70 

S-N  1 

247 

531 

2 

T2.5 

GRAYLING 

6 

3 

40  70 

S-N  ’ 

248 

502 

2 

T2.5 

GRAYLINC 

o 

5 

40  70 

N-S  J 

249 

50  3 

2 

T2.5 

GRAYLING 

6 

4 

40  70 

N-S  ] 

250 

50  4 

2 

T2.5 

GRAYLING 

6 

3 

40  70 

N-S  ■ j 

NUH 

MEROCIO 

CLASS 

TYPE 

SITE 

251 

50  5 

2 

T2.5 

GRAYLING 

252 

506 

2 

T2.5 

GRAYLING 

253 

507 

2 

T2.5 

grayling 

5u8 

2 

T2.5 

GRAYLING 

255 

509 

2 

T2.5 

grayling 

256 

510 

2 

T2.5 

GRAYLING 

257 

511 

2 

T2.5 

GRAYLING 

258 

512 

2 

T2.5 

grayling 

259 

513 

2 

T2.5 

GRAYLING 

260 

514 

2 

T2.5 

GRAYLING 

261 

515 

2 

T2.5 

GRAYLING 

262 

516 

2 

T2.5 

GRAYLING 

263 

51  7 

2 

T2.5 

grayling 

26^ 

51  e 

2 

T2.5 

GRAYLING 

265 

519 

2 

T2.5 

GRAYLING 

266 

520 

2 

T2.5 

GRAYLING 

267 

521 

2 

T2.5 

grayling 

268 

522 

2 

T2.5 

GRAYLING 

269 

523 

2 

T2.5 

GRAYLING 

270 

52  6 

2 

T5.C 

grayling 

271 

527 

2 

T5.C 

GRAYLING 

272 

528 

2 

T5.C 

GRAYLING 

273 

529 

2 

T5.0 

GRAYLING 

2?k 

53C 

? 

T5.C 

GRAYLING 

275 

531 

j 

T6.0 

GRAYLING 

27o 

532 

2 

T5.0 

grayling 

277 

534 

2 

T5.0 

GRAYLING 

278 

535 

2 

T5.C 

GRAYLING 

279 

53  6 

2 

T5.C 

grayling 

280 

537 

2 

T5.0 

GRAYLING 

281 

538 

C 

T5.0 

GPAYLING 

282 

539 

2 

T5.0 

grayling 

283 

340 

2 

T5.C 

GRAYLING 

284 

541 

2 

T5.0 

grayling 

285 

542 

2 

T5.0 

GRAYLING 

286 

543 

2 

T5.C 

graylinc 

287 

544 

2 

T5.C 

GRAYLING 

288 

545 

2 

T5.M 

GnAYLiNG 

289 

546 

2 

T5.C 

GRAYLING 

290 

547 

2 

T5.Q 

GRAYLING 

291 

54  8 

2 

T5.0 

GRAYLING 

292 

549 

2 

T5.C 

grayling. 

293 

550 

2 

T5.C 

GRAYLING 

294 

551 

2 

T5.0 

GPAYLING 

295 

555 

2 

M151 

FT. BRAGG 

296 

55b 

2 

M151 

FT. BRAGG 

297 

55  7 

2 

M151 

FT. BRAGG 

298 

55  8 

2 

M151 

FT. BRAGG 

299 

559 

2 

M151 

FT. BRAGG 

300 

560 

2 

M151 

FT. BRAGG 

SPEED 

STAKE 

A/S 

gain 

direction 

16 

1 

40 

70 

S-N 

16 

2 

40 

70 

S-N 

16 

4 

40 

70 

S-N 

16 

7 

40 

70 

N-S 

16 

6 

40 

70 

N-S 

16 

4 

40 

70 

N-S 

16 

2 

40 

70 

N-S 

22 

1 

40 

70 

S-N 

22 

3 

4u 

70 

S-N 

22 

5 

40 

70 

S-N 

22 

7 

40 

70 

N-S 

22 

4 

40 

70 

N-S 

22 

2 

40 

70 

N-S 

31 

0 

40 

70 

S-N 

31 

1 

40 

70 

S-N 

31 

4 

40 

70 

S-N 

31 

8 

40 

70 

N-S 

31 

5 

40 

70 

N-S 

31 

2 

40 

70 

N-S 

6 

1 

30 

70 

S-N 

6 

2 

3C 

70 

S-N 

6 

3 

30 

70 

S-N 

6 

6 

30 

70 

N-S 

6 

4 

30 

70 

N-S 

6 

3 

30 

70 

N-S 

16 

1. 

30 

70 

S-N 

16 

4 

30 

70 

S-N 

16 

8 

30 

70 

N-S 

16 

6 

3C 

70 

N-S 

16 

5 

30 

70 

N-S 

16 

3 

30 

70 

N-S 

22 

1 

30 

70 

S-N 

22 

3 

3C 

70 

S-N 

22 

5 

30 

70 

S-N 

22 

8 

30 

70 

N-S 

22 

5 

30 

70 

N-S 

22 

3 

30 

70 

N-S 

31 

0 

30 

79 

S-N 

31 

2 

30 

70 

S-N 

31 

5 

30 

70 

S-N 

31 

8 

30 

70 

S-N 

31 

•it 

3b 

70 

N-S 

31 

6 

30 

70 

N-S 

31 

-0 

30 

70 

N-S 

6 

11 

50 

70 

S-N 

6 

13 

50 

70 

S-N 

6 

9 

50 

79 

S-N 

16 

-0 

50 

70 

S-N 

16 

10 

5b 

70 

S-N 

16 

11 

5b 

70 

N-S 

A-8 


t.  * ! j.wwi.  n niji..  w.  iiqji,  m j ^ -^pw 


:.'l 

NUH 

NEROCIO 

CLASS 

TYPE 

SITE 

SPcEO 

STAKE 

A/S 

GAIN 

DIRECTION 

/!! 

301 

561 

2 

M151 

FT. BRAGG 

16 

9 

50 

70 

N-S 

302 

562 

2 

MlSl 

FT. BRAGG 

22 

8 

5 0 

70 

S-N 

303 

5 63 

2 

M151 

FT. BRAGG 

22 

10 

50 

70 

S-N 

t 

304 

564 

2 

M151 

FT. BRAGG 

22 

12 

50 

70 

S-N 

305 

565 

2 

M151 

FT. BRAGG 

22 

13 

50 

70 

N-S 

306 

566 

2 

M151 

FT.0RAGG 

22 

11 

50 

70 

K-S 

307 

567 

2 

M151 

FT. BRAGG 

22 

9 

fC 

70 

N-S 

306 

568 

2 

M151 

FT.BRAGG 

31 

8 

50 

70 

S-N 

309 

569 

2 

MlSl 

FT. BRAGG 

31 

12 

50 

70 

S-N 

r 

310 

570 

2 

MlSl 

FT. BRAGG 

31 

13 

50 

70 

N-S 

■w  - ••  . 

. 311 

. 571 

2 

MlSl 

FT. BRAGG 

31 

11 

50 

70 

N-S 

312 

572 

2 

MlSl 

FT.  BRAGG 

31 

8 

50 

70 

N-S 

0 

313 

573 

2 

T2.5 

FT. BRAGG 

6 

8 

50 

70 

S-N 

. 

314 

5 74 

2 

T2.5 

FT.BRaGG 

6 

10 

50 

70 

S-N 

315 

575 

2 

T2.5 

FT. BRAGG 

6 

-0 

50 

70 

S-N 

■c 

316 

576 

2 

T2.5 

FT.BRAGG 

6 

12 

50 

70 

N-S 

317 

5 77 

2 

T2.5 

FT.BRAGG 

6 

11 

50 

70 

N-S 

318 

578 

2 

T2.5 

FT.BRAGG 

6 

9 

50 

70 

N-S 

319 

579 

2 

T2.5 

FT.BRAGG 

16 

8 

50 

70 

S-N 

320 

580 

2 

T2.5 

FT.BRAGG 

16 

9 

50 

70 

S-N 

321 

561 

2 

T2.5 

FT.BRAGG 

16 

11 

50 

73 

S-N 

g> 

322 

583 

2 

T2.5 

FT.BRAGG 

16 

11 

50 

70 

N-S 

323 

584 

2 

T2.5 

FT.BRAGG 

16 

9 

5C 

70 

N-S 

324 

591 

2 

T2.5 

FT.BRAGG 

22 

8 

50 

70 

S-N 

c 

325 

592 

2 

T2.5 

FT.BRAGG 

22 

10 

50 

70 

S-N 

326 

593 

2 

T2.5 

FT.BRAGG 

22 

11 

50 

70 

S-N 

327 

594 

2 

T2.5 

FT.BRAGG 

22 

13 

50 

70 

N-S 

o 

326 

595 

2 

T2.5 

FT.BRAGG 

22 

11  • 

50 

70 

N-S 

329 

596 

2 

T2.5 

FT.BRAGG 

22 

9 

50 

70 

N-S 

330 

597 

2 

T2.5 

FT.BRAGG 

31 

9 

50 

rc 

S-N 

c 

331 

598 

2 

T2.5 

FT.BRAGG 

31 

12 

50 

70 

S-N 

332 

60  J 

2 

T2.5 

FT.BRmGG 

31 

11 

50 

70 

N-S 

333 

601 

2 

T2.5 

FT.BRAGG 

31 

9 

50 

70 

N-S 

'C 

334 

3 

1 

M107 

YUMA 

16 

1 

30 

70 

E-H 

335 

4 

1 

M10  7 

YUM' 

16 

5 

30 

70 

E-H 

336 

5 

1 

M107 

YUMA 

16 

8 

30 

70 

6-N 

Qj 

337 

6 

1 

M107 

YUMA 

16 

12 

30 

70 

E-H 

338 

7 

1 

M107 

YUMA 

16 

19 

30 

70 

£-H 

339 

8 

1 

M1C7 

YUMA 

16 

15 

30 

70 

H-E 

(ii? 

340 

9 

1 

M107 

YUMA 

16 

13 

30 

70 

H-E 

341 

10 

1 

M107 

YUMA 

16 

11 

30 

70 

H-E 

342 

11 

1 

M1C7 

YUMA 

16 

7 

30 

70 

H-E 

'C 

343 

13 

1 

M1C7 

YUMA 

16 

5 

30 

70 

E-H 

344 

14 

1 

H1G7 

YUMA 

16 

8 

30 

70 

E-H 

345 

15 

1 

M107 

YUMA 

16 

10 

30 

70 

E-H 

c 

346 

16 

1 

M107 

YUMA 

16 

12 

30 

70 

E'*H 

347 

17 

1 

M107 

YUMA 

16 

14 

30 

70 

e-K 

■' ' 

348 

19 

1 

Mli7 

YUMA 

16 

13 

30 

70 

H-£ 

W-’ 

349 

20 

1 

M107 

YUMA 

16 

11 

30 

70 

H-E 

o 

350 

21 

1 

M107 

YUMA 

16 

9 

30 

70 

H-E 

* 

o 

» 

A- 9 

• 

O 


t. 

NUM 

MEROCIO 

CLASS 

TYPE 

SITE 

SPEED 

STAKE 

A/S  GAIN 

DIRECTION 

< 

751 

22 

1 

M107 

YUHA 

16 

7 

30  70 

N-£ 

352 

23 

1 

M107 

YUMA 

22 

6 

30  70 

E-W 

353 

24 

1 

M1C7 

YUMA 

22 

6 

30  70 

E-H 

351* 

25 

1 

M107 

YUMA 

22 

10 

30  70 

e-w 

355 

26 

1 

Mlo7 

YUMA 

22 

11 

30  70 

E-M 

356 

27 

1 

M107 

YUMA 

22 

-a 

30  70 

E-H 

« 

357 

28 

1 

Hlu7 

YUMA 

22 

15 

30  70 

H-E 

358 

29 

1 

M107 

YUMA 

22 

10 

30  70 

H-E 

359 

30 

1 

H107 

YUMA 

22 

6 

30  70 

M-E 

* 

360 

31 

1 

M107 

YUMA 

22 

6 

30  70 

H-E 

361 

32 

1 

M107 

YUMA 

22 

10 

30  70 

E-H 

362 

33 

1 

H107 

YUMA 

22 

11 

30  70 

E-H 

c> 

363 

34 

1 

M107 

YUMA 

22 

13 

30  70 

E-H 

3 64 

35 

1 

M107 

YUMA 

22 

15 

30  70 

H-E 

365 

36 

1 

M107 

YUMA 

22 

13 

30  70 

H-E 

t 

366 

37 

i 

M107 

YUMA 

22 

11 

30  70 

H-c 

367 

38 

1 

M107 

YUMA 

22 

8 

30  70 

H-E 

368 

39 

1 

M1C7 

YUMA 

28 

7 

30  70 

E-H 

c. 

369 

40 

1 

M107 

YUMA 

28 

9 

30  70 

E-H 

370. 

41 

1 

M1C7 

YUMA 

28 

12 

30  70 

E-H 

371 

42 

1 

M107 

YUMA 

28 

14 

3C  70 

H-E 

< . 

372 

43 

1 

M1C7 

YUMA 

29 

12 

•30  70 

K-E 

373 

44 

1 

M1C7 

YUMA 

28 

8 

3u  70 

H-E 

3 74 

45 

1 

M1C7 

YUMA 

29 

6 

30  70 

E-H 

V 

375 

46 

1 

M107 

• YUMA 

28 

9 

30  70 

E-H 

376 

47 

1 

M1C7 

YUMA 

28 

13 

30  70 

E-H 

377 

48 

1 

M107 

YUMA 

28 

15  . 

30  70 

H-E 

C; 

378 

49 

1 

M1C7 

YUMA 

28 

13 

30  70 

H-E 

379 

50 

1 

M107 

YUMA 

28 

11 

30  70 

H-c 

380 

51 

1 

M107 

YUMA 

28 

8 

30  70 

l*-£ 

o 

3 81 

52 

i 

M60 

YUMA 

6 

15 

20  70 

H-t 

382 

53 

1 

H60 

YUMA 

6 

14 

20  70 

H-E 

383 

54 

1 

M60 

YUMA 

6 

12 

20  70 

W-E 

384 

55 

1 

M60 

YUMA 

6 

11 

20  70 

H-E 

365 

57 

1 

M6C 

YUMA 

6 

9 

20  70 

W-£ 

386 

58 

1 

M60 

YUMA 

6 

8 

20  70 

H-E 

v> 

387 

59 

1 

M60 

YUMA 

6 

7 

2C  70 

H-E 

388 

60 

1 

M60 

YUMA 

6 

5 

20  70 

E-H 

389 

61 

1 

M6C 

YUMA 

6 

7 

20  70 

E-H 

390 

62 

1 

M6Q 

YUMA 

6 

9 

20  70 

E-H 

391 

63 

1 

M60 

YUMA 

6 

10 

20  70 

E-H 

392 

64 

1 

M60 

YUMA 

6 

11 

20  70 

E-H 

t-. 

393 

65 

1 

H60 

YUMA 

6 

12 

20  70 

E-H 

3 94 

66 

1 

M60 

YUMA 

6 

15 

20  70 

H-E 

395 

67 

1 

M60 

YUMA 

6 

14 

20  70 

H-E 

396 

68 

1 

M60 

YUMA 

6 

12 

20  70 

H-E 

397 

69 

1 

H6C 

YUMA 

6 

11 

20  73 

H-E 

398 

70 

1 

H6Q 

YUMA 

6 

9 

20  70 

H-E 

1 

399 

71 

1 

M6C 

YUMA 

6 

8 

20  70 

H-c 

• 1 
t. 
'i 

400 

72 

1 

M60 

YUMA 

16 

6 

16  70 

E-H 

V- 

A- 10 

NUH 

MEROCIO 

CLASS 

TYPE 

SITE 

SPEED 

STAKE 

A/S  GAIN 

DIRECTION 

iiOl 

73 

1 

H60 

YUMA 

16 

7 

16  70 

E-K 

4»02 

74 

1 

M6C 

YUHA 

16 

9 

16  70 

E-H 

<*03 

75 

1 

M60 

YUMA 

16 

11 

16  70 

E-H 

<*0<» 

76 

1 

M£C 

YUMA 

16 

14 

16  70 

E-K 

40S 

77 

1 

M60 

YUMA 

, 16 

14 

16  70 

N-E 

<*06 

78 

1 

M60 

YUHA 

16 

11 

16  70 

K-E 

<»07 

79 

1 

M60 

YUMA 

16 

9 

16  70 

W-E 

408 

80 

1 

H60 

YUMA 

16 

6 

16  70 

K-E 

409 

81 

1 

M60 

YUMA 

16 

3 

16  70 

K-E 

410 

82 

1 

M60 

YUHA 

16 

4 

16  70 

E-H 

. . 411 

83 

1 

M60 

YUMA 

16 

7 

16  70 

E-H 

412 

84 

1 

H60 

YUMA 

16 

8 

16  70 

E-H 

. 413 

85 

1 

M60 

YUMA 

16 

11 

16  70 

E-H 

414 

86 

1 

M60 

YUMA 

16 

14 

16  70 

E-H 

415 

87 

1 

H6G 

YUMA 

16 

15 

16  70 

H-E 

416 

88 

1 

H60 

YUMA 

16 

12 

16  70 

H-E 

417 

89 

1 

M60 

YUMA 

16 

9 

16  70 

K-E 

418 

90 

1 

H60 

YUMA 

16 

6 

16  70 

H-E 

419 

91 

1 

M60 

YUMA 

22 

5 

16  70 

E-H 

420 

92 

1 

M6C 

YUMA 

22 

7 

16  70 

E-H 

421 

93 

1 

M60 

YUMA 

22 

9 

16  70 

E-H 

422 

94 

1 

YUMA 

22 

12 

16  70 

E-H 

423 

95 

1 

M60 

YUMA 

22 

15 

16  70 

E-H 

424 

96 

1 

M6C 

YUMA 

22 

18 

16  70 

H-E 

425 

97 

1 

H64 

• YUMA 

22 

14 

16  70 

W-E 

426 

98 

1 

H60 

YUMA 

22 

11 

16  70 

H-E 

427 

99 

1 

M6C 

YUMA 

22 

8- 

16  70 

W-E 

428 

100 

1 

M60 

YUMA 

31 

4 

16  70 

E-H 

429 

101 

1 

H60 

YUMA 

31 

8 

16  70 

E-H 

430 

102 

1 

H60 

YUHA 

31 

13 

16  70 

E-H 

431 

10  3 

1 

M60 

YUHA 

31 

16 

16  70 

E-H 

432 

104 

1 

MbC 

YUMA 

31 

17 

16  70 

H-E 

433 

10  S 

1 

M60 

YUMA 

31 

12 

lb  70 

H-E 

434 

106 

1 

M60 

YUMA 

31 

11 

16  70 

W-E 

435 

107 

1 

M6C 

YUMA 

31 

8 

16  70 

W-E 

436 

108 

1 

M6C 

YUMA 

31 

4 

16  70 

H-E 

437 

109 

1 

H6C 

YUMA 

31 

4 

16  70 

E-H 

438 

110 

1 

M60 

YUMA 

31 

8 

16  70 

E-H 

439 

111 

1 

M60 

YUMA 

31 

9 

16  70 

E-H 

440 

112 

1 

H6C 

YUMA 

31 

13 

16  70 

E-H 

441 

113 

1 

M6C 

YUMA 

31 

lb 

16  70 

E-H 

442 

114 

1 

M60 

YUMA 

31 

lb 

16  70 

W-E 

443 

115 

1 

H60 

YUHA 

31 

12 

16  70 

H-E 

444 

116 

1 

M60 

YUMA 

31 

10 

16  70 

H-E 

445 

117 

1 

M60 

YUMA 

31 

7 

16  70 

W-E 

446 

118 

1 

M113 

YUMA 

6 

4 

30  70 

E-H 

447 

119 

1 

M113 

YUMA 

6 

-0 

30  70 

E-K 

448 

120 

1 

M113 

YUMA 

6 

-a 

30  70 

E-H 

449 

121 

1 

M113 

YUMA 

6 

8 

30  70 

E-H 

450 

124 

1 

M113 

YUMA 

6 

-0 

30  70 

E-H 

A-  11 


NUH 

MERDCID 

CLASS 

TYPE 

SITE 

SPEED 

STAKE 

A/S  GAIN 

direction 

• 

^51 

126 

1 

M113 

YUMA 

6 

13 

30  70 

Vi"c 

452 

127 

1 

M113 

YUMA 

6 

11 

30  70 

H-E 

453 

128 

1 

M113 

YUMA 

6 

10 

30  70 

H-E 

i.  ■ 

454 

129 

1 

M113 

YUMA 

6 

9 

30  70 

H-E 

455 

130 

1 

M113 

YUMA 

6 

7 

3u  70 

E-H 

456 

131 

1 

M113 

YUMA 

6 

8 

30  70 

£-M 

457 

132 

1 

M113 

YUMA 

6 

9 

30  70 

E-H 

458 

133 

1 

M113 

YUMA 

6 

11 

30  70 

E-H 

459 

134 

1 

K113 

YUMA 

6 

12 

30  70 

E-W 

p 

460 

136 

1 

M113 

YUMA 

6 

12 

30  70 

H-E 

461 

137 

1 

MU  3 

YUMA 

6 

11 

30  70 

H-E 

462 

138 

1 

M113 

YUMA 

6 

lu 

30  70 

M-E 

<*► 

463 

139 

1 

M113 

YUMA 

6 

9 

30  70 

H-E 

464 

140 

1 

M113 

YUMA 

6 

-0 

30  70 

H-E 

<» 

465 

142 

1 

M113 

YUMA 

16 

8 

26  70 

£-H 

466 

143 

1 

M113 

YUMA 

16 

9 

26  70 

E-H 

467 

144 

1 

M113 

YUMA 

16 

11 

26  70 

E-H 

# 

468 

145 

1 

M113 

YUMA 

16 

13 

26  70 

H-t 

469 

146 

1 

MU  .3 

YUMA 

16 

11 

26  70 

H-E 

470 

147 

1 

M113 

YUMA 

16 

9 

26  70 

H-E 

* "% 

471 

148 

1 

M113 

YUMA 

16 

8 

26  7u 

H-E 

472 

149 

1 

Mill 

YUMA 

16 

7 

26  70 

E-H 

473 

150 

1 

N113 

YUMA 

16 

8 

26  70 

E-H 

474 

151 

1 

MU3 

YUMA 

16 

10  " 

26  70 

E-M 

475 

152 

1 

M113 

■ YUMA 

16 

12 

26  70 

E-H 

476 

153 

1 

M113 

YUMA 

16 

13 

26  70 

E-H 

477 

154 

1 

M113 

YUMA 

16 

14. 

26  70 

H-E 

•• 

478 

155 

1 

M113 

YUMA 

16 

12 

26  70 

H-E 

479 

156 

1 

M113 

YUMA 

16 

11 

26  70 

H-£ 

480 

157 

1 

H113 

YUMA 

16 

9 

26  70 

H-E 

481 

158 

1 

M113 

YUMA 

16 

7 

26  70 

H-E 

462 

159 

1 

M113 

YUMA 

22 

6 

26  70 

E-H 

483 

160 

1 

M113 

YUMA 

22 

8 

26  70 

£-H 

484 

162 

1 

M113 

YUMA 

22 

12 

26  70 

E-H 

485 

164 

1 

M113 

YUMA 

22 

15 

26  70 

H-E 

r» 

486 

165 

1 

M113 

YUMA 

22 

13 

26  70 

H-E 

487 

lo6 

1 

M113 

YUMA 

22 

11 

26  70 

H-E 

466 

167 

1 

M113 

YUMA 

22 

9 

26  70 

H-E 

jjw 

489 

168 

1 

M113 

YUMA 

22 

b 

26  70 

H-E 

490 

16  9 

1 

M113 

YUMA 

22 

4 

26  70 

E-H 

491 

I7u 

1 

M113 

YUMA 

22 

7 

26  70 

E-H 

x> 

492 

171 

1 

M113 

YUMA 

22 

9 

26  70 

E-H 

493 

172 

1 

M113 

YUMA 

22 

11 

26  70 

E-H 

494 

173 

1 

M113 

YUMA 

22 

14 

26  70 

E-H 

495 

174 

1 

M113 

YUMA 

22 

15 

26  70 

H-E 

496 

175 

1 

Milo 

YUMA 

22 

13 

26  70 

H-E 

497 

176 

1 

MU  3 

YUMA 

22 

11 

26  70 

H-E 

^ • ■ 

498 

177 

1 

M113 

YUMA 

22 

8 

26  70 

H-E 

499 

176 

1 

M113 

YUMA 

22 

5 

26  70 

H-£ 

500 

179 

1 

M113 

YUMA 

31 

5 

20  70 

E-H 
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NUH 

MEROCIO 

CLASS 

TYPE 

SITE 

SPEED 

STAKE 

A/S 

GAIN 

DIRECTION 

501 

180 

1 

M113 

YUMA 

31 

8 

20 

70 

E-M 

502 

181 

1 

H113 

YUMA 

31 

12 

20 

70 

E-N 

503 

182 

1 

M113 

YUMA 

31 

16 

20 

70 

N-E 

504 

183 

1 

Hi13 

YUMA 

31 

12 

20 

70 

M-E 

505 

184 

1 

H113 

YUMA 

31 

11 

20 

70 

M-E 

506 

185 

1 

M113 

YUMA 

31 

9 

20 

70 

H-E 

507 

186 

1 

M113 

YUMA 

31 

6 

20 

70 

E-H 

508 

187 

1 

M113 

YUMA 

31 

9 

20 

70 

E-H 

509 

138 

1 

M113 

YUMA 

31 

12 

20 

70 

E-H 

510 

189 

1 

H113 

YUMA 

31 

15 

20 

70 

E-H 

511 

190 

1 

H113 

YUMA 

31 

18 

20 

70 

H-E 

512 

191 

1 

H113 

YUMA 

31 

15 

20 

70 

H-E 

513 

192 

1 

M113 

YUMA 

31 

12 

20 

70 

H-E 

514 

193 

1 

M113 

YUMA 

31 

6 

20 

70 

H-E 

515 

194 

1 

M113 

YUMA 

31 

5 

20 

70 

W-E 

516 

195 

1 

H48 

YUMA 

6 

5 

26 

70 

E-H 

517 

196 

1 

M48 

YUMA 

6 

6 

26 

70 

E-H 

518 

197 

1 

H48 

YUMA 

6 

8 

26 

70 

E-H 

519 

198 

1 

H48 

YUMA 

6 

9 

26 

70 

E-H 

520 

199 

1 

M48 

YUMA 

6 

. 11 

26 

70 

E-H 

521 

23  0 

1 

M48 

YUMA 

6 

13 

26 

70 

E-H  • 

522 

201 

1 

M48 

YUMA 

6 

14 

26 

70 

H-E 

523 

2J2 

1 

M48 

YUMA 

6 

13 

26 

70 

H-t 

524 

203 

1 

M48 

YUMA 

6 

11 

26 

70 

H-E 

525 

204 

1 

M48 

YUMA 

6 

9 

26 

70 

H-E 

526 

20  5 

1 

H48 

YUMA 

6 

8 

26 

70 

H-E 

527 

20  € 

1 

M48 

YUMA 

6 

8‘ 

26 

70 

E-H 

528 

20  7 

1 

M48 

YUMA 

6 

9 

26 

70 

E-H 

529 

238 

1 

M48 

YUMA 

6 

10 

26 

70 

E-H 

530 

209 

1 

M48 

YUMA 

6 

11 

26 

70 

E-H 

531 

210 

4 

X 

M48 

YUMA 

6 

12 

26 

70 

E-H 

532 

211 

1 

M48 

YUMA 

6 

13 

26 

70 

H-c 

533 

212 

1 

M48 

YUMA 

6 

12 

26 

70 

W-E 

534 

213 

1 

M48 

YUMA 

6 

11 

26 

70 

W-E 

535 

214 

1 

M48 

YUMA 

6 

10 

26 

70 

H-E 

536 

215 

1 

M48 

YUMA 

6 

8 

26 

70 

H-E 

537 

216 

1 

M48 

YUMA 

16 

8 

20 

70 

e-H 

538 

217 

1 

M48 

YUMA 

16 

9 

20 

70 

E-H 

539 

218 

1 

M48 

YUMA 

16 

11 

20 

70 

E-H 

540 

219 

1 

M48 

YUMA 

16 

13 

20 

70 

E-W 

541 

220 

1 

M48 

YUMA 

16 

15 

20 

70 

W-E 

542 

221 

1 

M48 

YUMA 

16 

13 

20 

70 

H-E 

543 

222 

1 

M48 

YUMA 

16 

11 

20 

70 

W-E 

544 

223 

1 

H48 

YUMA 

16 

8 

20 

70 

W-E 

545 

224 

1 

M48 

YUMA 

16 

6 

20 

70 

W-E 

546 

225 

1 

M48 

YUMA 

16 

6 

20 

70 

c-W 

547 

22  6 

1 

H48 

YUMA 

16 

8 

20 

70 

E-H 

548 

227 

1 

M49 

YUMA 

16 

9 

20 

70 

E-H 

549 

228 

1 

M48 

YUMA 

16 

11 

20 

70 

E-H 

550 

22  9 

1 

M48 

YUMA 

16 

13 

20 

70 

F-W 

:l 
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NUH 

MtRDCiO 

CLASS 

TVPE 

SITE 

SPEED 

STAKE 

A/S  GAIN 

DIRECTION 

551 

230 

1 

M48 

YUMA 

16 

15 

20  70 

H-£ 

552 

231 

1 

M48 

YUMA 

16 

14 

20  70 

H-£ 

553 

232 

1 

H48 

YUMA 

16 

11 

20  70 

h-E 

55U 

233 

1 

M48 

YUMA 

16 

9 

20  70 

W-E 

555 

234 

1 

H48 

YUMA 

16 

6 

20  70 

M-t 

556 

235 

1 

M48 

YUMA 

22 

5 

20  70 

E-M 

'*" 

557 

236 

1 

H48 

YUMA 

22 

7 

20  70 

E-M 

558 

237 

1 

H48 

YUMA 

22 

9 

20  70 

E-W 

559 

238 

1 

M48 

YUMA 

22 

11 

2 0 70 

E-W 

t 

56C 

239 

1 

H46 

YUMA 

22 

13 

20  70 

E-W 

561 

240 

1 

H48 

YUMA 

22 

15 

20  7ii 

W-E 

562 

241 

1 

M48 

YUMA 

22 

13 

20  70 

W-E 

563 

242 

1 

H48 

YUMA 

22 

11 

20  70 

H-E 

56^ 

243 

1 

M48 

YUMA 

22 

8 

20  70 

H-E 

565 

245 

1 

M48 

YUMA 

22 

8 

20  70 

E-W 

(f 

566 

246 

1 

M48 

YUMA 

22 

9 

20  70 

E-W 

567 

247 

1 

M48 

YUMA 

22 

6 

20  70 

E-W 

568 

246 

1 

H46 

YUMA 

22 

8 

20  70 

E-W 

569 

249 

1 

M48 

YUMA 

22 

9 

20  70 

E-W 

5 7a 

250 

1 

H48 

YUMA 

22 

12 

20  70 

E-W 

571 

251 

1 

M48 

YUMA 

22 

14 

. 20  70 

E-W  , 

572 

2 52 

1 

M48 

YUMA 

31 

6 

16  70 

E-W 

573 

253 

1 

M48 

YUMA 

31 

12 

16  70 

E-W 

57M 

254 

1 

M48 

YUMA 

31 

17 

16  70 

W-E 

575 

255 

1 

M48 

YUMA 

31 

12 

16  70 

W-E 

576 

257 

1 

M48 

YUMA 

31 

8 

16  70 

W-E 

577 

271 

1 

M43 

GRAYLING 

6 

•0- 

20  40 

S-N 

5 78 

272 

1 

M48 

grayling 

6 

1 

20  40 

S-N 

579 

273 

1 

M48 

GvRAYLING 

6 

2 

20  40 

S-N 

580 

274 

■ 1 

M48 

GRAYLING 

6 

3 

20  40 

S-N 

581 

275 

1 

M48 

GRAYLING 

6 

9 

20  40 

S-N 

582 

276 

1 

M48 

GRAYLING 

6 

-0 

20  40 

N-S 

583 

277 

1 

M48 

GRAYLING 

6 

6 

20  40 

N-S 

564 

27  e 

1 

M40 

GRAYLING 

6 

5 

20  40 

N-S 

585 

279 

1 

M48 

GRAYLING 

6 

1 

20  40 

N-S 

586 

280 

1 

M48 

GRAYLING 

6 

1 

20  40 

N-S 

587 

281 

1 

M48 

GRAYLING 

16 

2 

20  40 

S-N 

588 

282 

1 

M48 

grayling 

16 

5 

20  40 

S-N 

589 

283 

1 

H48 

GRAYLING 

16 

7 

20  40 

S-N 

0^ 

590 

284 

1 

P48 

GRAYLING 

16 

8 

20  40 

N-S 

591 

285 

1 

M48 

GRAYLING 

16 

7 

20  40 

N-S 

592 

286 

1 

M48 

GRAYLING 

16 

5 

20  40 

N-S 

00 

593 

287 

1 

M48 

GRAYLING 

16 

2 

20  40 

N-S 

594 

288 

1 

M48 

grayling 

20 

1 

20  40 

S-N 

595 

289 

1 

M48 

GRAYLING 

20 

3 

20  40 

S-N 

00 

596 

29  u 

1 

M48 

GRAYLING 

20 

5 

20  40 

S-N 

597 

291 

1 

M48 

GRAYLING 

20 

8 

20  40 

S-N 

598 

292 

1 

H48 

GRAYLING 

20 

8 

20  40 

N-S 

599 

293 

1 

M48 

GRAYLING 

20 

6 

20  40 

N-S 

1 

600 

294 

1 

M48 

GRAYLING 

20 

4 

20  40 

N-S 

A-14 
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NUM 

HERDCIO 

Class 

TYPE 

SITE 

SPEED 

STAKE 

A/S 

GAIN 

DIRECTION 

601 

295 

1 

M48 

GfiAYLlNG 

20 

1 

20 

40 

N-S 

602 

296 

1 

M113 

grayling 

6 

0 

3 6 

70 

S-N 

603 

297 

1 

M113 

GRAYLING 

6 

1 

36 

70 

S-N 

604 

3i)0 

1 

M113 

GRAYLING 

6 

5 

36 

70 

S-N 

605 

302 

1 

M113 

GRAYLING 

6 

7 

36 

70 

N-S 

606 

303 

1 

Mill 

grayling 

6 

b 

36 

70 

N-S 

607 

304 

1 

M113 

GRAYLING 

6 

5 

36 

70 

N-S 

608 

305 

1 

M113 

GRAYLING 

6 

4 

36 

70 

N-S 

609 

30  7 

1 

H113 

GRAYLING 

6 

-0 

36 

70 

N-S 

610 

309 

1 

M113 

GRAYLING 

16 

7 

36 

70 

N-S 

611 

310 

1 

M113 

GRAYLING 

16 

5 

36 

70 

N-S 

612 

311 

1 

M113 

GRAYLING 

16 

2 

36 

70 

N-S 

613 

312 

1 

H113 

GRAYLING 

16 

J 

36 

70 

S-N 

614 

313 

1 

M113 

GRAYLING 

16 

2 

36 

70 

S-N 

615 

314 

1 

M113 

GRAYLING 

16 

4 

36 

70 

S-N 

616 

315 

1 

M113 

GRAYLING 

16 

8 

36 

70 

N-S 

617 

316 

1 

M113 

GRAYLING 

16 

. 6 

36 

7C 

N-S 

616 

317 

1 

M113 

GRAYLING 

16 

4 

36 

70 

N-S 

619 

318 

i 

M113 

GRAYLING 

16 

2 

36 

70 

K-S 

620 

319 

1 

M113 

GRAYLING 

22 

8 

36 

70 

N-S 

621 

320 

1 

M113 

GRAYLING 

22 

5 

36 

70 

N-S 

622 

321 

1 

M113 

GRAYLING 

Zl 

1 

36 

70 

N-S 

623 

322 

1 

M113 

GRAYLING 

22 

u 

36 

70 

S-N 

624 

324 

1 

M113 

GRAYLING 

22 

6 

36 

70 

S-N 

625 

32  5 

1 

M113 

GRAYLIN  C 

28 

0 

36 

70 

S-N 

626 

326 

1 

M115 

GRAYLING 

28 

2 

36 

70 

S-N 

627 

32  7 

1 

M113 

grayling 

28 

5 

36 

70 

S-N 

626 

32  6 

1 

M113 

GRAYLING 

28 

9' 

36 

70 

S-N 

629 

329 

1 

M113 

GRAYLING 

28 

8 

36 

70 

N-S 

630 

330 

1 

Mil3 

GRAYLING 

28 

6 

36 

70 

N-S 

631 

331 

1 

H113 

GRAYLING 

28 

2 

36 

70 

N-S 

632 

332 

1 

Mil3 

FT. BRAGG 

6 

12 

40 

70 

N-S 

633 

334 

1 

M113 

FT. BRAGG 

6 

10 

40 

70 

N-S 

634 

335 

1 

M113 

FT.  BRAGG 

6 

8 

40 

70 

N-S 

635 

337 

1 

M113 

FT. BRAGG 

16 

11 

40 

70 

S-N 

636 

336 

1 

M113 

FT. GRAGG 

16 

13 

40 

70 

S-N 

637 

339 

1 

M113 

FT. BRAGG 

16 

14 

40 

70 

N-S 

636 

340 

1 

M113 

FT. BRAGG 

16 

12 

40 

73 

N-S 

639 

341 

1 

M113 

FT.ORAG6 

16 

6 

4C 

70 

N-S 

64Q 

342 

M113 

FT. BRAGG 

16 

6 

40 

70 

N-S 

641 

343 

1 

M113 

FT. BRAGG 

22 

6 

40 

70 

S-N 

642 

344 

1 

M113 

FT. BRAGG 

22 

6 

40 

70 

S-N 

643 

345 

1 

M113 

FT. BRAGG 

22 

10 

40 

70 

S-N 

644 

346 

1 

M113 

FT. BRAGG 

22 

11 

40 

70 

S-N 

645 

347 

1 

M113 

FT. BRAGG 

22 

-0 

40 

70 

S-N 

646 

346 

1 

M113 

FT. BRAGG 

22 

14 

40 

70 

N-S 

647 

349 

1 

M113 

F T.  BRAGG 

22 

12 

40 

70 

N-S 

648 

351 

1 

MllJ 

FT. BRAGG 

22 

8 

40 

70 

N-S 

649 

352 

1 

M113 

FT. BRAGG 

25 

5 

40 

70 

S-N 

650 

3 53 

1 

M113 

FT. BRAGG 

25 

8 

4C 

70 

S-N 

t 


NUH 

MEROCIO 

CLASS 

TYPE 

SITE 

SPEED 

STAKE 

A/S 

GAIN 

DIRECTION 

r' 

651 

354 

1 

H113 

FT«BRA6G 

25 

11 

40 

70 

S-N 

652 

355 

1 

M113 

FT*  BRAGG 

25 

14 

40 

70 

S-N 

653 

356 

1 

M113 

FT.ERAGG 

25 

14 

40 

70 

N-S 

•'* 

654 

357 

1 

M113 

FT. BRAGG 

25 

13 

40 

70 

N-S 

655 

35  € 

1 

M113 

FT. BRAGG 

25 

11 

40 

70 

N-S 

656 

359 

1 

M113 

FT. BRAGG 

25 

9 

40 

70 

N-S 

1^ 

657 

360 

1 

H113 

FT.BRAGG 

25 

7 

40 

70 

N-S 

658 

364 

1 

M48 

FT. BRAGG 

6 

14 

30 

70 

N-S 

659 

366 

1 

H48 

FT.BRAGG 

6 

11 

30 

70 

N-S 

660 

36( 

1 

H48 

FT.BRAGG 

16 

-0 

30 

70 

S-N 

661 

369 

1 

H48 

FT.BRAGG 

16 

15 

30 

70 

N-S 

662 

370 

1 

M48 

FT.BRAGG 

16 

12 

30 

70 

N-S 

o 

663 

371 

1 

M48 

FT.BRAGG 

16 

11 

30 

70 

N-S 

664 

372 

1 

M48 

FT.BRAGG 

16 

9 

30 

70 

N-S 

665 

373 

1 

H<*8 

FT.BRAGG 

16 

7 

30 

70 

N-S 

o 

666 

374 

1 

M48 

FT.BRAGG 

20 

12 

30 

70 

N-S 

667 

375 

1 

H4S 

FT.BRAGG 

20 

9 

30 

70 

N-S 

668 

376 

1 

H48 

FT.BRAGG 

20 

7 

30 

70 

N-S 

o 

669 

377 

1 

M48 

FT.BRAGG 

20 

5 

30 

70 

S-N 

670 

378 

1 

M4d 

FT.BRAGG 

20 

7 

30 

70 

S-N 

671 

380 

1 

H48 

FT.BRAGG 

20 

12 

30 

70 

S-N 

o 


o 


o 


o 


o 
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APPENDIX  C 

SYLVANIA  FEATURE  EXTRACTOR  DATA 

1.  STC  and  SATC  Flow  Chart  Showing 
Transfer  Functions 

2.  Difference  Equations  Used  in 
Sylvania  Feature  Extractors 

3.  FORTRAN  Program  Feature  Extractor 
Samples 
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Seismic 
Variance  of 
Variance  Frequency 


DIFFERENCE  EQUATIONS  USED  IN  SYLVANIA  FEATURE  EXTRACTORS 


1 


(1)  1-Pole  LPF 

Z = 1/(1+Ts)-  y.  = Ax^  + By._^ 

where  A = 2n"At/(l  + 2TifAt) 

B = 1/(1  + 2TTfAt) 

= Present  Input  Value 
y^  = Present  Output  Value 
y^  ^ = Past  Output  Value 

f = Cutoff  Frequency 

At  = Sampling  Interval 

(2)  2-Pole  LPF 

Z = 1/(1+Ts)2  yi  = ^^i-l  ■ ^^1-2 

where  A = (2TrfAt  )^/C(2TrfAt  + 2(2iTfAt)  + 1] 

B = [2(2TTfAt)  + 2]/[(2irfAt)^  + 2(2TTfAt)  +1] 
C » l/C(2TrfAt)^  + 2(27TfAt)  + 1] 

(3)  3-Pole  LPF 

y/x  = 1/(1+Ts)(l+Ts+T^s^) 

. y.  = Ax^  + By._^  - Cy._2  + Dy^^^ 

where  A = 2(27rf  At  )^/DEN 

B = [2(27TfAt)^  + 4(2ufAt)  + 3]/DEN 

C = C2(2TrfAt)  + 3]/DEN 

D = 1/DEN 

DEN  = (27TfAt)^  + 2(2TTfAt)^  + 2(2TTfAt)  + 1 

(4)  1-Pole  HPF 

y/x  = Ts/d+Ts)-^  = A(x^-x^_3^+y^_3^) 

where  A = l/(2TrfAt  + 1) 


C-  5 


Sample  Output  From  the  Sylvanla  Feature  Extractor  FORTRAN  Program 

(a)  Sinusoidal  test  function  with  increasing  frequency 

(b)  Low  pass  filter  output 

(c)  Low  band  amplifier  output 

(d)  Full  wave  rectifier  output 

(e)  10  Hz  LPF  output 

(f)  Low  band  envelope  feature 


APPENDIX  D 

ADAPTIVE  LEARNING  NETWORK  NONLINEAR  DISCRIMINANT  FUNCTION 
STRUCTURES,  EIGENVECTOR  WEIGHTS,  AND  TABLE  OF  ERRORS  AND 
CLASS  1 AND  CLASS  2 ERROR  HISTOGRAMS  WITH  RESPECT  TO  RANGE 
FOR  NONLINEAR  CLASSIFIER  G 
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FIGURE  D.l:  NONLINEAR  PAIRWISE  DISCRIMINANT  FUNCTION:  CLASS  1 VERSUS 
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FIGURE  D.2: 


NONLINEAR  PAIRWISE  DISCRIMINANT  FUNCTION:  CLASS  1 VERSUS 

CLASS  3 
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FIGURE  D. 3:  NONLINEAR  PAIRWISE  DISCRIMINANT  FUNCTION  CLASS  1 VERSUS 
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NONyNEAR  PAIRWISE  DISCRIMINANT  FUNCTION  CLASS  1 VERSUS 
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FIGURE  D.5: 

NONLINEAR 

PAIRWISE 

DISCRIMINANT  FUNCTION  CLASS 
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FIGURE  D.2:  NONLINEAR  PAIRWISE  DISCRIMINANT  FUNCTION:  CLASS  2 VERSUS 
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FIGURE  D.7i  NONLINEAR  PAIRWISE  DISCRIMINANT  FUNCTION  CLASS  2 VERSUS 
CLASS  4 

D-9 


c 


■ - 

- ■ 

. . 

NFTHOW  HEICl-TtHC 

COFFriCIEHTS  ■ 

LfM 

HO 

HI 

HO 

H3 

H4 

MO 

1 

-.3<»i93?*0e 

-.«t?i.rfte-8i 

.E70E7E  «U1 

-.«»509fcE4!l0 

-.  13746E401 

.2iei6F*Cl 

? 

-.Hn»flr*rc 

-.93?11F*00 

.ll*9tE»01 

-.97749E401 

. 24773F431 

.?7028E4rt 

.... 

y 

-.1?S05E»00 

• ?t.9H,F«01 

-.63909E400 

-,l«*5bE430 

.3ZSlSF«tt 

ti  ■ 

.5^n^F*ce 

-,r6i4qiE»oc 

-.799777400 

.174505431 

-.  25  946F401 

-.23247F4C1 

5 

,no^«r*co 

-.50156E400 

-.9E259E400 

-.1C9Z7E40C 

-.42401F430 

-.29377E4C1 

f 

,?75I.^F*00 

.e5?5*E*00 

• 31591E400 

.449965400 

-.37199E400 

•.32$21E*tC 

? 

.??r'iiF*oo 

.93E09F400 

• 99709F-01 

.74995E400 

-.19?29E400 

-.35750F400 

O 

.isrsie4fo 

.10S13E431 

-.9*tlSf>F-01 

.7F83PE401 

-.894S6E400 

•.21506E»ei 

0 

-.1  75'i»F4CQ' 

.30«39F40C 

.7  3979F400 

.16265E4J0 

1C 

-.101i.OF*fO 

.767raE4no 

■.2  79997  400 

.13453E400' 



11 

,16«»9ftF*00 

.7369  3E401 

-.1390  OF  401 

-.1S502E9S0 

..  - : 

FIGURE  D.8:  NONLINEAR  PAIRWISE  DISCRIMINANT  FUNCTION;  CLASS  2 VERSUS 
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■FIGURE  D.9:  NONLINEAR  PAIRWISE  DISCRIMINANT  FUNCTION:  CLASS  2 VERSUS  \ 
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FIGURE  D.IO:  NONLINEAR  PAIRWISE  DISCRIMINANT  FUNCTION:  CLASS  3 VERSUS 

CLASS  4 


D-12 


NETN09K  MEICFTINS 

COEFFICIENTS 

npn 

NO 

Nt 

N2 

NS  NN 

NS 

1 

-.103S1C»01 

-.25005F  «0t 

.19*»62E*01  tM.791F*00 

.?6S6?C*C1 

? 

-.561«1F*rO 

>.29<.StE*01 

.99?09E«01 

-.31976E*31  .3PF71c*oi 

.2t411E*ri 

”.3?1'5F*C0 

*.3203»F»31 

-.19l»ll.F*nt 

.liP41liF«01  .3l.?79E*CI 

.4>27  99F*C1 

-- - ,, 

-.1  «F75F*eO 

- -.«»sqq7E*0C 

-,309?5F«01 

-.73045E731  -.77298E-01 

.73107E-f2 

.37C10F*r0 

.1271tE*01 

-.l9f.«.3EOO 

.93612E*3C  -.92F.95FF00 

.?3226E*ro 

f 

.^73^^F♦C0 

.95170F*00 

.10011F«09 

-.I91«6E«00  -.1M90E*00 

,24«(tE*ec 

7 

. Jsro'jFtcc 

.OF90’e»00 

.1676  9F«09 

-.61770E-91  -.?"mE*00 

.16430F-C1 

r 

-.^OflF^PO 

.rS037F*()0 

.25<tO"F«l)9 

.32053E*00 

9 

-.30719^*00 

• 791<(OE»00 

.21?ISE«00 

.T1654E*aO 

le 

.30?TOF*00 

.flS6?<te»oo 

.199?«iE«00 

-.30466E*00 

FIGURE  D.ll:  NONLINEAR 

CLASS  5 

PAIRWISE 

DISCRIMINANT  FUNCTION:  CLASS 

3 VERSUS 

H .iII-M.IUHIIIIIII.MJI  iill|lllWBBpiS»WW?WPWB<WfWPPWPW^lWWW!WP8PW^ 


liiiilpipilli 


I " 


I : 


eiFH 

1 

? 

1 

(t 

9 

tr 


.«?rpsr*ro 

-.n?9sc*co 

-.?95<>%r*co 

-.fciF’SEtra' 

,fc»i.<>4e»cc 

,S9S<.6f*C0 

-.lt03«'7E*tfl 


Ml 


NETMOW  MEICMINC,  COfFFICICNTS 
M7  N3 


‘.iS6«?e*oi 
,37i.67E*01 
>.<*19l5F40t 
.JllE0F*Ol 
.10361C*01 
• ice<>iF»ot 
.lOeS’E*!)! 
.•.rzEiE^ao 
.5739?E»00 
.7?ltl4EtaO 


.1M93F»01 
.6t979E«01 
.73791F40I 
.93969E*01 
.90107E»01 
.33349E-01 
.9  7463E-01 
.5?976F«na 
.9  779FF400 
.27631E«00 


-.9iri6F*oe 
.10601E«07 
-.lt2fc3E»  J7 
.T791kE*01 
,3l.09i.E»50 
.775ft7E-01 
« .11933E*00 
-.li?9eOE*00 
•.)>C3ZSE»00 
.l)C376E»00' 


.6n316E«0t 

,9i.*'93F*01 
. l»i.75F«01 
. 3F  74qE*DO 
,46M9F*00 
.$79E«iE790 


MS 

. 30090e»Ge 
• .37993E7C1 
.3t90<E»ri 
.12306E*r? 
•.19113E7C0 
-.3<>9eBE>Cl 
.37S27E>01 


FIGURE  D.12: 


NONLINEAR  PAIRWISE  DISCRIMINANT  FUNCTION: 
CLASS  6 


CLASS  3 VERSUS 


D-14 


i t, 


► 4,5 




...  m.i 

. 1 

' 

NFTMORK  MFI6I-TINC 

cortriciENTS 

5 



FLFH 

MO 

Ml 

MZ 

M3 

WM 

MS  . .. 

1 

-.?7i.95e*01 

,7Z707F«01 

.13i*90F*91 

,10*85F*01 

• 387  77E*ei  ' 

? 

-.jitstrr+co 

.iznie-oi 

-.Z09»SE*01 

.lt5aiE*Cl 

.3t5l»3F*01 

.iite4F*ti 

y 

-.?^0'i?C*P0 

.53S9  9e*01 

.1  76C»F«J1 

-.35l0aE*31 

-.9C?I.OE*01 

.ioicor*ri 

... 

t ■ 

■ -.?3i?ie*oi 

.qqitif  *01 

.1?10?E*0? 

-.3FF(18E*01 

.10567F*tZ 

? 

• 6ti.71F»rO 

.3C6F5e*ei 

-.31791F«01 

-.95150E*01 

.?7fllF*01 

• 9.3S06F*tl 

f 

.ITOCStttC 

-.trHitie+oi 

.trsicEioo 

.teoroEtoi 

-.7SOOzf*01 

.ZS8tl£*Cl 

7 

-.isttsf.pc 

.l?0l<3F*ni 

-.137«?F*')9 

- .ozmoF^oi 

.Z3  3«,2F*01 

. 333SlE*tl 

* 

-.1  T^lTr.rO 

.1095»E»01 

.?aqi3E*oo 

• 59ri?F-01 

.9tZtliE-01 

Q 

-.?l«=ltF*fC 

.?lAtSE*00 

,or3<.*E«0D 

-.t1510E*S0 

,i.Fie8E*00 

.37064E*rO 

• ir 

-.?i.o*.sF*rP 

.6577ne*00 

.399llF*00 

-.1H31E*01 

.7S18SE*00 

.6l>7ZtE*tO 

11 

,tt3’6F-tl 

.toa6i«E»00 

.ZttlliE  *00 

-.7f6atE-ai 

1? 

.6919<iF*30 

.35984E-01 

IS 

.Joo’tF-ri 

.?013«E*00 

,00010E*00 

-.*3ZZZE-01 

!<• 

-.S?l.'7F-01 

.«3t5qF*00 

.1601S'‘*09 

.?4zqitE-oi 

1* 

-.i77'!ie-ri 

.?7i.37E*0O 

,73l.orE*09 

.16769E-01 

It 

.yit?t?F-ci 

.4Z96liE*00 

.57310F*00 

-.3tl3ZE- tfl 

FIGURE 

D.13:  NONLINEAR 

PAIRWISE 

DISCRIMINANT  FUNCTION:  CLASS 

4 VERSUS 

CLASS  5 

NET  MOW  METCFTtN'-. 

COEFFICIENTS 

- ..  — 

FtrH 

MO 

Ml 

ME 

M3 

M*) 

NS  . 

1 

-.?9T^FF»C0 

-.<.?9<.<E*01 

-.1  W71F«P1 

-.1F6SSF411 

“.  31  M6F.401 

.39675E4ri 

r 

-.«!ii7f,r»ro 

-.77770F*01 

-.1  3?05F»01 

.??57<.E401 

-.10^.021401 

.lSS39E4fl 

iE»C0 

-.«.7<10?E7tll 

-.?3U7»E401 

-.7l.6lFe401 

-.41  .744E401 

-.68436F4C1 

t 

-.i.o^7’F»ro 

-.l«3*.*9F»01 

.srsiNFtoo 

.71075F400 

-.JN'OOf  401 

-.4S354E4tO 

? 

-.7«177f*C0 

*.<iF971P*31 

-.1  1739E401 

-.17009E401 

-.  3;<.74E401 

•.2«4lt7E4tl 

f> 

• I’niF^ri 

J9N55E»01 

-.109E7F«01 

.F00f,OE4  01 

. 1?J79E*02 

.21516E4T0 

T 

,ii,Q^i^r400 

.?6fl'9‘!F*01 

-.7991l.E«0t 

-.l?43tE43? 

.19770E401 

.8S010C4P1 

.J?'l 0F700 

.E?90?F  «01 

•8F53bE40 ■ 

-.?*F?3E401 

-.14242E4C1 

e 

.7?f.03P»00 

,319t7F«03 

.If?*-  . 

. 31  FF,3F4C0 

.6«446F-ri 

10 

• ,i,PQ17r»ro 

.93501P*00 

.1 1N09E400 

-.11  'P4  0L' 

.F.1110F401 

.56347E4ri 

11 

-.■;<*C71F*00 

.6*O35F*«0 

.37197F40D 

.OF.  £.-01 

.338627400 

.13577E4C0 

1? 

-.?n.ri,r*ro 

.93fc0’E»00 

.EE6E7F403 

.FFS73C430 

.19?'>3f430 

-.52S70E-C1 

l?l 

•5E*f0 

.1FFJ5E-01 

.9<H.5<.F«I)P 

.1J9I.0E401 

-.8OF99F400 

-.226flOF4tO 

Ifc 

.«??99P«00 

.SONP'IF^OO 

.?C77SF*00 

. 15  791F400 

.t<4SlSF4tO 

1“ 

-.?'57«^F*tr 

-.1531ltF*Cl 

.?5i';«r«3i 

-.ir674E401 

-.  1776  2E400 

.16704E401 

1» 

.?*0«)0F*  to 

.N0  730F*00 

.3  9E9  3F  400 

-.78079E400 

ir 

.SflM^F^rc 

.SkN?9F«0C 

,li57P«F  400 

-.''•7?i,£400 

1* 

.?17*5F*  00 

.riiliSf  *00 

.7»q7->F40e 

-.E9S10E400 

i« 

.77i.OFr*00 

,7?(.o<iF*00 

.E77TCE  400 

-.T?»>l.7C*flO 

?T 

-.fcOl'iir^fO 

.515l(9f  *00 

,fc05i,lir4n3 

.ttaiNNEFOO 

?1 

-.J'?7qr»oo 

.if  f39E»no 

.33iilir400 

.33MSE400 

?? 

.For^c^to 

.FlC49e*00 

,l  83S7F  fOO 

-.?«E61F400 

FIGURE  D.14:  NONLINEAR  PAIRWISE  DISCRIMINANT  FUNCTION:  CLASS  4 VERSUS 
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TABLE  D.2 

ERRORS  MADE  IN  NONLINEAR  CLASSIFIER  G FOR  THE  SIX  TARGET  CLASSES 


( 


( 

NUM 

HEROCIO 

CLASS 

TYPE 

SITE 

(' 

1 

498 

6 

N 

GRAYLING 

2 

553 

6 

N 

FT.RFAGG 

3 

554 

6 

N 

FT.RRAGG 

4 

586 

6 

N 

YUMA 

5 

603 

5 

HI 

YUMA 

g- 

- 620' 

■ ■ 5'  "■ 

Hi 

YUMA 

7 

679 

4 

UH-l 

FT.OPAGG 

8 

679 

4 

UH-1 

FT.BFAGG 

9 

640 

3 

TA-4 

FT.BPAGG 

( 

10 

642 

3 

TA-4 

FT.npAGG 

11 

642 

3 

TA-li 

FT.BPAGG 

644 

■3  ■ 

TA-4 

FT.BPAGG 

( 

13 

645 

3 

TA-4 

FT.BPAGG 

14 

650 

3 

TA-4 

FT.BPAGG 

15 

655 

3 

OV-10 

FT.BFAGG 

(" 

. 

387  ' 

2 

M151 

YUMA 

17 

389 

2 

M151 

YUHA 

18 

392 

2 

M151 

YUMA 

( 

19 

403 

2 

T2.5 

YUMA 

20 

411 

2 

T2.5 

YUMA  . 

21 

412 

2 

T2.5 

YUMA 

, 

22 

415 

2 

T2.5 

YUMA 

23 

420 

2 

T2.5 

YUMA 

24' 

--430  ■ 

....  2_. . 

M715 

YUMA 

25 

436 

2 

M715 

YUMA 

26 

437 

2 

M715 

YUMA 

27 

439 

2 

M715 

YUMA 

r 

28 

450 

2 

M792 

YUMA 

29 

456 

2 

H792 

YUMA 

30  ' 

■ 465 

■■'2 

M792  ■■ 

YUMA 

31 

505 

2 

T2.5 

GRAYLING 

32 

516 

2 

T2.5 

GRAYLING 

33 

521 

2 

T2.5 

GRAYLING 

34 

522 

2 

T2.5 

GRAYLING 

35 

556 

2 

M151 

FT.BPAGG 

' 36 

. 

2 

H151  ■ 

FT.BPAGG" 

! 

37 

571 

2 

M151 

FT.BFAGG 

38 

576 

2 

T2.5 

FT.BFAGG 

39 

581 

2 

T2.5 

FT.BPAGG 

( 

40 

593 

2 

T2.5 

FT.BPAGG 

41 

598 

2 

T2.5 

FT.BPAGG 

42 

1‘  ' 

M107  ■ 

YUMA  ' 

C 

43 

28 

1 

H107 

YUMA 

44 

39 

1 

H107 

YUMA 

45 

41 

1 

M107 

YUMA 

( 

46 

47 

1 

M107 

YUMA 

47 

90 

1 

M60 

YUMA 

48 

236 

1 

M48 

YUMA"  ■ 

' 

49 

245 

1 

M41 

YUMA 

50 

272 

1 

M48 

GRAYLING 

SPEED 

RANGE 

A/S  GAIN 

DIRECTION 

StT  

-0 

-0 

60  70 

E 

-0 

-0 

30  70 

N-S 

E 

-0 

-0 

30  70 

M-S 

E 

-0 

-0 

50  7U 

E 

3 

20 

70  70 

N-S 

E 

* - -- 

. j ._ 

■ -500 

"60  70 

■ *S-N  ■■ 

60 

600 

40  70 

E 

60 

600 

40  70 

E 

250 

200- 

40  70 

£ 

300 

200 

23  70 

E 

300 

200 

23  70 

E 

450  " 

' 200  ' 

23  70  ' 

■ ••  - 

E 

450 

200 

23  70 

E 

450 

400 

40  70 

E 

150 

200 

40  70 

E 

16 

-0 

50  70 

E-M 

E 

16 

20 

50  70 

M-E 

E 

22 

100 

50  70  ■ 

M-E  ■ ■ 

■■  "'E'* 

6 

20 

46  70 

M-E 

E 

22 

100 

40  70 

E-M 

E 

22 

-200 

40  70 

F-M 

E 

22 

-0 

40  70 

M-E 

E 

31 

-200 

40  70 

M-E 

E 

-16  ■ 

"■300  ■ 

- 46  70  * 

M-E""' 

E’ 

22 

300 

46  70 

M-F 

E 

22 

100 

46  70 

M-E 

0 

22 

-100 

46  70 

M-E 

0 

16 

300 

46  70 

M-E 

E 

22 

400 

40  70 

E-M 

E 

■ 31 

-100 

40  70' 

E-M  ■■ 

E " 

16 

200 

40  70 

S-N 

0 

22 

100 

40  70 

N-S 

E 

31 

500 

40  70 

N-S 

E 

31 

200 

40  70 

N-S 

E 

6 

-20 

50  70 

S-N 

E 

31" 

"-200  ■■ 

50  70 

S-N 

0 

31 

100 

50  70 

N-S 

0 

6 

200 

50  70 

N-S 

E 

16 

-100 

50  70 

S-N 

E 

22 

-100 

50  “^O 

S-N 

E 

31 

-200 

50  70 

S-N 

E 

— 2^  - 

“-100 

30  70 

E-M 

. 

22 

500 

30  70 

M-E 

E 

28 

300 

30  70 

E-M 

E 

28 

-200 

30  70 

E-M 

E 

28 

-300 

30  70 

E-M 

E 

16 

-400 

16  70 

M-E 

E 

22 

300 

20  70  ■ 

E-M  ■ 

E 

22 

200 

20  70 

E-M 

E 

6 

200 

20  40 

S-N 

E 
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TABLE  D.2 
(Continued) 


HUM 

MEROCIO 

CLASS 

TYPE 

SITE 

SPEED 

RANGE 

A/S 

GAIN 

DIRECTION 

SET 

SI 

274 

1 

M48 

GRAYllRG 

6 

-20 

20 

40 

S-N 

e 

S2 

275 

1 

H49 

GRAYLING 

6 

-6  00 

20 

40 

S-N 

E 

S3 

277 

1 

M48 

GRAYLING 

6 

300 

29 

40 

N-S 

0 

54 

279 

1 

M48 

GRAYLING 

6 

-200 

20 

40 

N-S 

D 

55 

28  0 

1 

H43 

GRAYLING 

6 

-200 

20 

40 

N-S 

E 

56 

281  ~ 

■~1  - 

M48 

GRAYLING 

16 

100 

20 

40 

S-N 

E 

57 

286 

1 

M48 

GRAYLING 

16 

200 

20 

40 

N-S 

E 

58 

287 

1 

M48 

GRAYLING 

16 

-100 

20 

40 

N-S 

E 

59 

288 

1 

H4S 

GRAYLING 

20 

200 

20 

40 

S-N 

E 

60 

294 

1 

H44 

GRAYLING 

20 

100 

20 

40 

N-S 

E 

61 

295 

1 

M48 

GRAYLING 

20 

-200 

20 

40 

N-S 

E 

62 

302 

1 

M113 

GRAYLING 

6 

400 

36 

70 

N-S 

E 

63 

332 

1 

M113 

ET.RFAGG 

6 

200 

40 

70 

N-S 

E 

64 

337 

1 

M113 

FT.9FAGG 

16 

-100 

40 

70 

S-N 

E 

b5 

338 

1 

H113 

FT.RPAGG 

16 

-300 

40 

70 

S-N 

E 

66 

339 

1 

M113 

FT.BFAGG 

16 

400 

40 

70 

N-S 

E 

67 

340 

1 

M113 

FT.PFAGG 

16 

200 

40 

70 

N-S 

E 

68 

346 

1 

M113 

FT. BRAGG 

22 

-100 

40 

70 

S-N 

E 

69 

349 

1 

M113 

ft.ppagg 

22 

200 

40 

70 

N-S 

E 

70 

352 

1 

M113 

FT.9PAGG 

25 

500 

40 

70 

S-N 

0 

71 

354 

1 

M113 

FT. BRAGG 

25 

-100 

40 

70 

S-N 

D 

72 

355 

1 

M113 

FT.BFAGG 

25 

-400 

40 

70 

S-N 

D 

73 

356 

1 

M113 

FT.BFAGG 

25 

400 

40 

70 

..  ..  N-S 

D 

74 

357 

1 

M113 

FT.BPAGG 

25 

300 

40 

70 

N-S 

E 

75 

360 

1 

M113 

FT.BFAGG 

25 

-300 

40 

70 

N-S 

E 

76 

370 

1 

M48 

FT.BFAGG 

16 

200 

30 

70 

N-S 

E 

77 

377 

1 

M48 

FT.BFAGG 

20 

500 

30 

70 

S-N 

E 

”D"  stands  for  design  and  "E"  for  evaluation  under  title 
descriptor  "SET." 


Class  Numbers 


